Hierarchical Co-Attention Network<cite> (Lu et al., 2016)</cite> generates multiple levels of image attention based on words, phrases and complete questions, and is the top entry on the VQA Challenge 1 as of the time of this submission.