We first test a variant of our full framework by replacing the Encoder and QA Matching component with the CNN based model from<cite> (Yang et al., 2015)</cite> 2 , denoted as GAT w/ CNN, and train it with our objective.