Stuff, especially harem, is often mistagged. For example, the vast majority of reverse harem do not have harem tags and a TON of action manhwa will not have a harem tag even when there is a literal harem (i.e., MC gets multiple romantic partners, not just a bunch of people falling for the MC).
Why does this happen? The author is NOT the one dictating the tags on illegal sites, so the tags are decided by either the uploader here or the uploader on the other illegal site the story was ripped from. Unless the story is based on a novel, there is no way for an uploader to tell when they first upload a chapter if there is harem or not (well, if the place they get the raws from has tags, they can probably get them there but since I don't look at raws, I don't know how that works out). Also some uploaders surprisingly don't think that reverse harem is harem, which is a different cam of worms.
Additionally, the tags rarely get updated here. I've seen stories completely mistagged (like shoujo being tagged shoujo ai or action getting tagged shoujo) and they just kinda stay wrong.
Tldr; I wouldn't trust the tags that much for harem on this site. Trust your gut
But like, there's no harem tag??? Unless I'm missing it somewhere. Because I'm pretty sure most of the girls that like Beryl just have daddy issues and puppy love, and Beryl has the vibe of a parent who loves seeing his children grow. As much as it feels predatory or harem-ish, Beryl isn't inclined to having anyone as his wife (from what I have seen)