• Hierarchical Co-Attention Network (HieCoAtt)<cite> (Lu et al., 2016)</cite> with word-level (HieCoAtt-W), phrase-level (HieCoAtt-P) and question-level (HieCoAtt-Q) attention maps; we evaluate all three maps 3 .