MEDITRON-70B
Free while signed in. Answers cite the passages they came from.
EPFL's MEDITRON is an open-source family of medical LLMs at 7B and 70B parameters, continually pretrained on curated medical corpora.
Llama 2 base + medical pretraining: Builds on Llama 2 with continual pretraining on a curated medical corpus covering clinical papers, guidelines, and textbooks.
Strong open medical baseline: MEDITRON-70B outperforms GPT-3.5 and Med-PaLM on standard medical QA benchmarks while being open-source.
Close to frontier: Comes within 5% of GPT-4 and 10% of Med-PaLM 2 on MultiMedQA - competitive given the much smaller scale and open release.
Reproducible recipe: Ships with pretraining data, code, and weights, providing a reproducible starting point for researchers and institutions building medical LLMs.
Get next week’s papers.
The same picks and the same summaries, in your inbox. Free, and 176 issues deep.
Subscribe on Substack