What do i do now

So, a friend of mine said he was dropping me because I made a very rude comment about him in a situation where we were joking about each other. I apologised instantly, but his exact words were i kept being mean to him and that he didnt vibe with my energy. This would make anyone seem to think that I was the bad person in this situation, but when I reflected, I honestly didnt remember the last time I was even mean to him, and could only remember when he yelled at me in front of everyone for no reason. Him cutting me off is crazy to me because there was a person who made a racially targeted joke towards him, but after he apologised, they were still friends. What i told him was nowhere even close to that magnitude btw. That month, we also hung out privately, where I apologised to him for any mean comment I ever made before to him, and told him that I had an insecurity about me being mean. He said he understood and even reassured me, so I actually thought I could trust him as a friend. I actually talked to him yesterday because my friend asked me to, and he said that he wanted to drop me as a friend because I was mean to everyone else, where I told him that was a weak excuse and that he couldnt be the spokesperson of everyone. I feel very hurt with him using my privately told fears against me, and wonder if I actually am in the wrong because of this.