For all experiments, we take the multiple templates approach where a model sees different paraphrases of the same question during training. This approach was shown by <cite>Levy et al. (2017)</cite> to have significantly better paraphrasing abilities than when only one question template or simpler relation descriptions are employed.