II. Legal instruction finetuning further boosts the resultsAs seen on Figure 2, finetuning SaulLM-7B on both general and legal instructions (SaulLM-7B-Instruct) establishes a new state-of-the-art on the LegalBench-Instruct benchmark, with an average score of \(0.61\), i.e. an \(11\)% relative improvement compared to the best open-source instruct model (Figure 5. Finally, DPO-aligned models tend to underperform their instruction-tuned counterparts, which could be explained by the fact that generic alignment is not suited for out-of-distribution tasks, such as the ones present in LegalBench-Instruct. Although beyond the scope of the present work, an interesting research direction would be to explore how legal-specific DPO can help.