I don't think his big brother or father are awful people that hurt Chan in the past, I think Chan's mother is the awful person here and abused Chan in some way. Maybe Chan's mother would demonize everybody in Chan's life and there was emotional incest going on. Chan probably doesn't realize his relationship with his mother is unhealthy or disgusting, he just thinks she did everything she did to protect him and show him how much she loves him. she ostracized him from the family to keep Chan all to herself. As we can tell Chan only likes older women and never dated anybody before, he just had sex friends.
Maybe the way Chan was raised fucked him up in some way, since Chan is a man himself does he hate himself as well? Was he always attracted to men but his hatred for men made him suppress it and made him hate men more than he already did? I see Chan as a bisexual man but he wasn't able to explore his sexuality until now because he was completely ignoring it.

And Yechan’s hatred for men could very well just be for laughs, but at the same time, the fact that he hates his own dad and brother because they’re men makes me think there might be a deeper, darker reason why.
I hope not, because it’s supposed to be a comedy, but also, it would add depth to the character if there was an actual reason why.
I’ve been rg inking though, that through his interactions with Seokjun (and developing feelings for him), he’ll eventually get over his irrational hatred for men.