We start with a basic optimization objective <cite>(Mikolov et al., 2013b)</cite> and introduce several meaningful and intuitive constraints that are equivalent or closely related to previously proposed methods (Faruqui and Dyer, 2014; Xing et al., 2015) .