In this paper, we present a pioneering initiative to develop the first legal LLM publicly available. Legal text, characterized by its unique syntax and specialized vocabulary presents a distinct linguistic challenge [13, 26]. Our approach focuses on extensive pretraining [15, 22] using dedicated legal corpora from English-speaking jurisdictions such as the USA, Canada, the UK, and Europe [1, 18]. Leveraging the pretraining on a large and diverse legal dataset, both scraped by our team as well as from previous literature [26], our LLM, SaulLM-7B, aims not only to comprehend the complexities of legal documents but also to adapt to the evolving nature of legal discourse.