It can be scary to confront people because....

They might reject me.

They may reject me or misunderstand or verbally or physically attack me like an ex-neighbor did.

I'm scared of their opinion, failure, rejection. My anxiety just makes it seem as though so many things can go wrong

You cannot know if they are being honest with you. Also, you don't know that person's intentions. Words can be thrown and expressed easily these days. According to words alone, anyone can be anything.

You have no clue how they may react.

They will leave me

do not know what response you will get for no reason they could yell at you making you feel like you have done something wrong shattering your confidence

They may reject you.

Feel rejected yes

I fear the judgement of other people. I always think that I could let them down.