We applied the definition of direct bias from<cite> Bolukbasi et al. (2016)</cite> on the ELMo representations of the professional words in these sentences. where N is the amount of gender neutral words, g the gender direction, and w the word vector of each profession.