Our evaluation results show that our proposed approach significantly outperforms the state-of-the-art method of <cite>Aletras and Stevenson (2013)</cite> and a relevant method originally utilized for image annotation proposed by Weston et al. (2010) .