I kinda wish that the prince was listening in, saves him, then tells him he is the father

He doesn't know if he is truly indeed the father, though.

If he was listening in he would know, because he remembers the night. The MC is the one who doesn't remember