**Rationale Filtering and Training.** When it comes to knowledge distillation, data cleaning processes play a crucial role in preventing errors or noises included in the generation from the teacher LM being inherited to the student LM. Thus, we filter samples associated with unfaithful responses to the prompt (_i.e._, not providing rationales prior to providing a final answer) and inaccurate answer prediction.