In our main experiment, we compare the BSAE model's performance on different test sets when trained with three different training sets: the original SQuAD data (Original-SQuAD), SQuAD data augmented with <cite>AddSent</cite> generated adversaries (similar to adversarial training conducted by <cite>Jia and Liang (2017)</cite>), and SQuAD data augmented with our AddSentDiverse generated adversaries.