I think you forgot that she chose to stand by him. She chose to stay inside that estate. Telling him to “deal with your mess without bringing her down” overlooks her choices too. She gets to decide how involved she wants to be. He clearly listens to her (did not execute his vassals and let her go to the subjugation) because he knows she is strong. His past explains why he’s scared of what might happen to her. His mistake is letting that fear speak for both of them.

Okay, we got it, you do have a sad past BUT that does not allow you to be an asshole with the FL. She isn't a "thing" you can't decide her future nor protect her from the world, deal with your mess without bring her down with you.
She's trying her best to help you and your people, let her do her best. Trust her, she's good and you know it.