Translation of "Harem" in Japanese

It appears that I don't have it in me to have a harem in my charge.

私には後宮の支配者になる資質は、どうやらないようだ。