StarCoder
First page
Paper summary
An open-access 15.5B code LLM with 8K context and 80+ programming languages.
Ask this paper
01
Fully-open release: Released under OpenRAIL with training data (The Stack), training code, and model weights all public.
02
80+ programming languages: Broadly multilingual in code, including non-English natural language in comments and strings.
03
8K context: Long context enables reasoning over larger code files than prior open code LLMs.
04
Community base: Became the base for many community code models and powered LMStudio-style local coding assistants.