In Table 16, we demonstrate that incorporating \(\mathcal{L}_{\text{NLL}}\) into the DPO objective results in notable enhancements for translations both to and from English. This observation hints at why \(\mathcal{L}\)prefer, as an approximation of \(\mathcal{L}_{\text{DPO}}\), performs effectively, while the original DPO loss does not. It appears that the DPO loss lacks the BC regularizer, which steers the model towards the preferred data distribution. Although combining DPO with the BC regularizer could yield similar performance to CPO, it incurs double the memory cost and FLOPs per token in the forward pass. The original DPO loss shows the possibility of failure to improve the model performance in preference learning, so we here highlight the significance of incorporating BC regularization. Importantly, Table 16 shows that \(\mathcal{L}_{\text{prefer}}\) is a successful approximation of the DPO loss, offering savings in memory and speed, and it can even outperform the original BC-regularized DPO loss \(\mathcal{L}_{\text{DPO}}+\mathcal{L}_{\text{NLL}}\).