I think he can't TBH. He needs heirs. It secures his throne and the nation's heritage.
He would love to put Taiga (FL's father) on the throne, but he knows that right now at least:
1)Taiga has no noble support.
2) He used to scare the commoners who just heard scary rumours (likely spread by his horrid brothers).
3) Taiga's heritage isn't as strong as his brothers.
4) Taiga just doesn't want to play the 'succession' game. He'd protect his people and nation *his way* but till the FL entered the scene he didn't see the point.

why the princes and they wives look like commoners??? also, where is royal etiquette??? also why is the emperor enable the 2 eldest princes' behavior. like i were him i would ve stripped them of their titles