1-I am worried to be alone.Unnatural
2-Being alone worries me.Fine
3-I am worried about being alone.Fine
In which case:
a-I am alone and that worries me
b-I am going to be alone and that worries me I feel worried when I am alone,
c-I am worried that I might be alone.