Training

PMC-LLaMA

First page

Paper summary

A LLaMA model fine-tuned on 4.8 million medical papers.

Ask this paper

Key points

Domain-specific continued pretraining: Extends LLaMA's medical knowledge through continued pretraining on PubMed Central papers.

Biomedical QA: Achieves high performance on biomedical QA benchmarks, narrowing the gap with proprietary medical LLMs.

Open medical LLM: As a fully open model, accessible to academic medical researchers without proprietary model constraints.

Medical LLM ecosystem: Part of the 2023 medical LLM boom that established the template of general LLM + medical continued pretraining + medical SFT.

Every Monday