I think that a "ladies night" isn't that far of a cry from a "white people's night" or a "black people's night". 

However, that said, I understand that women feel more comfortable in an environment with other women.

What I think is right, is to have a "women's preferred night", where women are encouraged to attend, but men, and all other gender identities are welcome, as well. 