Following the work of <cite>Klementiev et al. (2012)</cite> ; Hermann & Blunsom (2014) ; Gouws et al. (2014) we represent each word as a vector and use separate word representations for each language.