However, following the idea of adversarial examples in image recognition (Goodfellow et al., 2014; Kurakin et al., 2016; Papernot et al., 2016) ,<cite> Jia and Liang (2017)</cite> point out the unreliability of existing question answering models in the presence of adversarial sentences.