I don't see how it would be dumb. It is normal to feel annoyed over annoying behaviors. The readers are as pissed at the Uke as the Seme: it is just Empathy 101.
Just because it is premise does not mean people have to be emotionally numb to actions that would normally irk them. Not everyone reacts the same; that's a quite invalidating to call them dumb because they do not acclimate to the weirdness: it is their opinions.

to the people who find the mc weird and annoying, he's mentally ill idk what you guys expect lol