From time to time I wear womens clothes since I'm not tall and i have a small chest with big hips so for example women's dress shirts fit me perfectly and don't look baggy like men's shirts of the same neck size. I also like t-shirts where they just use the exact same T-shirt for both male and female. In my opinion as long as you are confident and OK with looking slightly androgynous then you can pretty much wear anything as long as you don't end up looking like you're mocking trans people.