Am I the only one who hates this guy?!?

no

Correction: Only two that hate him

No. I mean I don't hate him but find him SO annoying

Honestly I don’t hate him but their are some moments where he frustrates me.

tbh I love hyesungs character, in the beginning he was a 'little' annoying (read "very") and hard to understand but I think he's calmed down and now I can understand him better. I couldn't imagine going through all the things he's gone through. Even if he's in a good situation now. AND I think that without his character the story would be a LOT more boring :)