Despite performing well when evaluated on <cite>AddSent</cite>, the retrained model suffers a more than 30% decrease in F1 performance when tested on a slightly different adversarial dataset generated by AddSentMod (which differs from <cite>AddSent</cite> in two superficial ways: using a different set of fake answers and prepending instead of appending the distractor sentence to the context).