Story I've been looking for but don't remember enough to search on my own

So I remember there being a black haired ml in a cave, he's the like enemy of the fl and I think she injured him but she has to heal him, he may have partial amnesia? There was also a scene before she meets him in the cave where there's a beastman or animal ear person who worked under the ml before his defeat? And he's being discriminated against either like maybe buying something or being accused of stealing or something, I don't fully remember. If any of this wounds familiar enough to have you help point me in the right direction I'd truly be ever great full and appreciate the help. It is colored too just to help narrow it down. I can't remember if FL had blonde or red hair or not also. And it's not the one where he thinks she's his wife.