Code

Survey on Language Models for Code

First page

Paper summary

A comprehensive survey of LLMs for code covering 50+ models, 30+ evaluation tasks, and 500 related works.

Ask this paper

Key points

Model landscape: Catalogs 50+ code LLMs across sizes, architectures, and training regimes, providing a single reference for what's available.

Task taxonomy: Reviews 30+ evaluation tasks spanning code generation, repair, translation, summarization, and execution prediction.

Training and data recipes: Walks through pretraining corpus construction, instruction tuning, and RLHF specifically for code.

Open problems: Highlights challenges in long-context code understanding, multi-file reasoning, and robust evaluation beyond HumanEval-style metrics.

Every Monday