As shown in Figure 2, the implementation of RL enables the model to achieve additional improvements in both rationale qualities and task performance. However, in line with Joshi et al. (2023)'s findings, a slight decrease in task performance is observed at the cost of maximized rationale qualities when selecting top-quality rationales. There may be several underlying factors involved (e.g., models' unfaithfulness), but this is not the scope of this work.