I can't completely put my finger on it, but I felt something very off with the ML and his family. His brothers were a**holes, but that wasn't the reason I felt flags, so to speak. I think that it was that almost all of them (especially the ML) had weird reactions to nearly every situation or development. If I'd been thrown into their milieu, I would have been itching to leave right away while expecting someone to go homicidal or burst into song at the sight of breakfast.
Keir O'Connell's Mistress