All perfect praise be to Allaah, The Lord of the Worlds. I testify that there is none worthy of worship except Allaah, and that Muhammad, sallallaahu ‘alayhi wa sallam, is His slave and Messenger.
The interpretation of the verse in which Allaah Says (what means): {…or those male attendants having no physical desire.}[Quran 24:31], refers to an effeminate who has no erection or a naive man who has no inclination or desires towards women. It is permissible for such a person to enter upon non-Mahram women. However, if he appears to have any signs which show that he understands the matters of women, then in this case, he should be prevented from entering upon them just like any other non-Mahram men.
For more benefit, please refer to Fatwa 91587.
Allaah Knows best.