Figure 8: **Perplexity on legal documents for pretrained backbones.** SaulLM-7B-Instruct outperforms other pretrained backbones on most types of legal documents, but is outperformed by Llama2-7B on Legislation. SaulLM-7B-Instruct exhibits a median perplexity of \(8.69\), having a reduction of \(5.5\) percent compared to Mistral-7B, \(9.20\), and \(10.8\) percent compared to Llama2-7B, with a median perplexity of \(9.74\).