If you read the manga, it's because he grasped them at their lowest point in life. It also didn't help that all other men they meet are just as bad. At the very least, they were with a pretty reliable and honest guy because standards were off to hell at this point.
Idk how I managed to read through all that but just know I did and that's all I have to say.