Following Section 2, we consider 10 translation directions in the paper: cs+en, de+en, is+en, zh+en, ru+en. Building on the ALMA models' (Xu et al., 2023) insights that a small quantity of high-quality data can yield impressive translation results, our training dataset is even more compact. As detailed in Section 3.1, our preference training data is derived from the FLORES-200 dataset, a subset of which has been also employed in the training of ALMA models. This results in a total of \(2\text{K}\times 10\) directions \(=20\text{K}\) paired sentences. In addition to preference data assessed by large evaluation models, our dataset incorporates 1K internal human-labeled preference data, containing preferred and dis-preferred translations along with human preference. However, the human-labeled data is limited to just two translation directions: en\(\rightarrow\)zh and en\(\rightarrow\)de. The details regarding the composition and influence of human-labeled data are explored in Appendix D.4 In alignment with Xu et al. (2023), our primary focus is on the test set drawn from WMT'21 for is and WMT'22 for other languages. Additionally, we conduct auxiliary experiments evaluating models on WMT'23, covering six directions: de+en, zh+en, and ru+en.