To effectively capture these patterns, in contrast to previous works that rely on various hand-crafted features<cite> Bansal et al., 2014)</cite> , we extract features by leveraging the distributed representations that embed images (Simonyan and Zisserman, 2014) and words as compact vectors, based on which the semantic closeness is directly measured in vector space.