The Question-Context Attention Layer is a fully-aware attention module <cite>[12]</cite> which takes the history (concatenation of GloVe, low-level, and high-level features) of each context word and question words as query and key for three attention modules, and represents each context word as three different vectors: