We used the L2 norm to mitigate over-fitting<cite> (Kiros et al., 2015)</cite> . Specifically, we use Visual Semantic Embeddings (VSE) of<cite> Kiros et al. (2015)</cite> and Order Embeddings (OE) of Vendrov et al. (2016) .