Why am I thinking that it was her father who puts restrictions on her

It would make sense if he thought the duke (or whatever he is) would assassinate her in order to ensure the other princess becomes the heir. Personally, I doubt that other princess is actually the emperors daughter.

Could it have been her uncle the duke????

I second that. If his father put it he wouldn't abandoned her in her first life