Well from what I can find it's been used as a noun since the 14th century, about the same time it started being used as an adjective. Mainly because it came from an Old French word for woman.    Either way, it's a lot less abhorant than people that use woman as an adjective.