Ignore the one person hating below

While i understand that the romance was kinda unnecessary.. the ML did not have any feelings for the FL when they were younger.. they were both adults when he started having feelings.. saying things like he was mentally 60 years old when in both lives he was the same age as the FL.. just that he returned to the past and she did not.. what was he suppose to do.. date a 60 year old woman when he himself is presently 20.. if he did that you would say the woman is a pedo..