Further, in order to improve robustness to <cite>AddSent</cite>'s semantic perturbations (e.g., antonyms), we jointly improve the model's semantic-relationship learning capabilities in addition to our AddSentDiversebased adversarial training data augmentation.