Large Language Models (LLMs) have exhibited a profound understanding of natural language, improving performance on an array of tasks [5]. Using open web data has helped in creating general-purpose LLMs with a broad range of capabilities. General-purpose LLMs are however not "specialists"; for example, while LLMs could write good news articles, it would be hard-pressed to write specialized legal documents.