**Comparing With SFT and DPO** All training objectives in our study are fine-tuned using the ALMA-13B-LoRA model as a base. In Table 2 and 3, we observe that SFT on preferred data marginally enhances the ALMA model's translation capability for xx\(\rightarrow\)en, and results in a slight deterioration for en\(\rightarrow\)xx. Similarly, DPO slightly decreases model performance. In contrast, CPO demonstrates significant improvements across all translation directions.