**Pushing the Performance Boundary of SFT** We introduce Contrastive Preference Optimization, which offers advantages in terms of memory efficiency, speed, and, crucially, enhanced effectiveness in improving translation quality. CPO breaks the performance bottleneck inherent in SFT's reference-mimicking learning process and push the performance boundary of models that have reached saturation through SFT training.