I don't know if I'm the problem

I feel like this is a messed up thing to think and it makes me toxic in a way, so my partner has these friends, and one of them I used to date for like a week none of my relationships lasted more than a week so maybe I'm the problem but but these friends of theirs talk very badly about me things that I know aren't true they still hang out with their friends and it's come to the point I think it's going to have to be me to break up with them or them to break up with me, my friends yell at me to talk about it even though I know nothing good will come out of it so I find it pointless on Friday it will be three weeks in this relationship But I don't know what to do because I feel like going mute whenever something bad happens and I really don't like this so I tend to stay silent I don't know what to do