SaulLM-7B: LLM for Law
Free while signed in. Answers cite the passages they came from.
SaulLM-7B is an open legal-domain LLM built on Mistral 7B and continually pretrained on 30B+ tokens of English legal text, with a companion instruction-tuning recipe.
Legal pretraining corpus: 30B+ tokens of case law, statutes, regulations, and other legal documents covering U.S. and international jurisdictions.
Legal instruction tuning: A novel fine-tuning method uses legal-task instructions to convert the continually pretrained model into an instruction-following legal assistant.
SoTA on LegalBench: Reports state-of-the-art results on LegalBench-Instruct and legal subsets of MMLU, outperforming general-purpose 7B models on statute interpretation, contract analysis, and legal QA.
MIT-licensed release: Model and training artifacts are released under MIT, making it a practical starting point for legal-domain RAG, contract review, and compliance workflows.
Get next week’s papers.
The same picks and the same summaries, in your inbox. Free, and 176 issues deep.
Subscribe on Substack