The concubines were not only required by the need of an heir, they also served as a political alliance, the most powerful and noble families sent one of their legitimate daughters to serve the emperor, the concubine could intervene for her family, they also helped for the political alliance between countries ╮( ̄▽ ̄)╭
They must earn her favor or "affection" if they want to sleep with her and have more power in the harem, haha