Answer type prediction Inspired by the Augmented QANet model <cite>(Dua et al., 2019)</cite> , we use the contextualized token representations from the last four blocks (H L−3 , ..., H L ) as the inputs to our answer predictor, which are denoted as M 0 , M 1 , M 2 , M 3 , respectively.