It is shown that many published models for the Stanford Question Answering Dataset (Rajpurkar et al., 2016) lack robustness, suffering an over 50% decrease in F1 score during adversarial evaluation based on the <cite>AddSent</cite> <cite>(Jia and Liang, 2017)</cite> algorithm.