There has also been a great deal of work on sentence-based image search or cross-modal retrieval where the objective is to learn a joint space for images and text (Hodosh et al., 2013; Frome et al., 2013;<cite> Kiros et al., 2015</cite>; Socher et al., 2014; Donahue et al., 2015) .