Code · Data

Magicoder

First page

Paper summary

Magicoder is a fully open-source code LLM that closes the gap with top commercial code models at only 7B parameters via high-quality synthetic instruction data.

Ask this paper

Key points

OSS-Instruct data: Generates 75K synthetic instruction pairs by seeding GPT with snippets pulled from open-source code, producing more diverse and realistic training data than prior code SFT datasets.

Broad coverage: Training data spans Python, multilingual programming, and data-science program completion, producing a genuinely general code model rather than a Python-only model.

HumanEval+ win: MagicoderS-CL-7B (based on CodeLlama) surpasses ChatGPT on HumanEval+ with 66.5 vs. 65.9 pass@1, despite being 7B.

Fully open: Ships with code, data, and weights, positioning Magicoder as a reproducible open baseline for instruction-tuned code generation.

Every Monday

Magicoder

Ask this paper

Get next week’s papers.