Hey there @Dumbo, I understand completely what you mean by this, and all I can say is, when our anxiety is at a high, you know as well as I do it can be pretty hard to manage, we can give off the wrong signals to people, and appear irritable, aggravated, short tempered, I honestly think in my case, people tend to "keep there distance" because they don't want to be on the receiving end of my attitude, and why should they? It's my problem and insecurities I have to control and manage without the pressure of upsetting others, because when this also happens, the guilt kicks in too.
Have you ever thought people may keep there distance, not because they don't like this side of you, but, because they understand this side of you? And By keeping there distance and avoiding you, this is their way of helping you, not making things worse for you, not adding extra pressure on you!
I think you also need to remember just how hard it is keeping your anxiety under control, which very clearly you can, and not to beat yourself up, when there are times that you can't. We all have blips, its allowed, and it's okay, you are dealing anxiety, and doing a fine job, you have anxiety, I have anxiety, but anxiety hasn't got us because we fight we fight back!
I wish you well Dumbo, you have got this, I just feel it. Take care of you.