Wait I'm slow how does he know his brother I thought he lost his memories

His brother calling lee yeon in the middle of the night and chaewoo see that, he curious who is this bastard calling someone wife at that time so he pick her phone in front of her and they talk (with lee yeon too)~

They had talked once over the phone before (a few chapters back).

Thank you I need to reread