The uke here isn't neglected but it had the same description with the three other clues
http://www.mangago.me/read-manga/koi_nanka_shitakunai/
omg I know this one, I read this before too. ughh
agh i think i know what youre talking about although the title is also escaping me..
..is it by watanabe asia maybe??
I thought it was wonderful days but I was wrong.
-timid uke
-he was neglected as a kid? That's how the seme found him and took him in
-seme doesn't wanna admit his feelings because he wants to stay as "family"
-seme brought a guy home just to make that clear to the uke that they'll stay as family