MEDITRON-70B
First page
Paper summary
EPFL's MEDITRON is an open-source family of medical LLMs at 7B and 70B parameters, continually pretrained on curated medical corpora.
Ask this paper
01
Llama 2 base + medical pretraining: Builds on Llama 2 with continual pretraining on a curated medical corpus covering clinical papers, guidelines, and textbooks.
02
Strong open medical baseline: MEDITRON-70B outperforms GPT-3.5 and Med-PaLM on standard medical QA benchmarks while being open-source.
03
Close to frontier: Comes within 5% of GPT-4 and 10% of Med-PaLM 2 on MultiMedQA - competitive given the much smaller scale and open release.
04
Reproducible recipe: Ships with pretraining data, code, and weights, providing a reproducible starting point for researchers and institutions building medical LLMs.