Magicoder
Free while signed in. Answers cite the passages they came from.
Magicoder is a fully open-source code LLM that closes the gap with top commercial code models at only 7B parameters via high-quality synthetic instruction data.
OSS-Instruct data: Generates 75K synthetic instruction pairs by seeding GPT with snippets pulled from open-source code, producing more diverse and realistic training data than prior code SFT datasets.
Broad coverage: Training data spans Python, multilingual programming, and data-science program completion, producing a genuinely general code model rather than a Python-only model.
HumanEval+ win: MagicoderS-CL-7B (based on CodeLlama) surpasses ChatGPT on HumanEval+ with 66.5 vs. 65.9 pass@1, despite being 7B.
Fully open: Ships with code, data, and weights, positioning Magicoder as a reproducible open baseline for instruction-tuned code generation.
Get next week’s papers.
The same picks and the same summaries, in your inbox. Free, and 176 issues deep.
Subscribe on Substack