**Rationale Distillation.** For rationale generation from the teacher model, we randomly sampled 15K examples from each of the two datasets, resulting in a total of 30K examples. After filtering invalid rationales, the dataset was reduced to a total of 23K examples. 90% of data was used for training, and the remaining 10% was used for validation. For training, we used 8 NVIDIA Tesla V100 GPUs with 16GB configurations. Hyperparameters for training are as follows: 3e-3 for learning rates, 5 epochs, 64 batch size.