Naturalized Execution Tuning (NExT)
Free while signed in. Answers cite the passages they came from.
NExT teaches LLMs to reason about program runtime behavior by generating synthetic chain-of-thought rationales over execution traces. The approach bootstraps training data through self-training rather than manual annotation, and the learned reasoning transfers to scenarios where traces are unavailable at inference.
Execution-aware rationales: The model inspects variable states at each step of a program's execution and produces natural-language rationales explaining what is happening, then fine-tunes on those rationales.
Self-training bootstrap: No human-annotated rationales are needed - rationales for correct repairs are kept and used to teach the model, scaling naturally across many programs.
Large repair gains: On PaLM 2, NExT improves fix rate by +26.1% on MBPP and +14.3% on HumanEval (absolute), with both automated metrics and human evaluators rating the rationales as higher quality.
Trace-free generalization: At inference the model applies the same reasoning patterns without live execution traces, showing it learned transferable execution-aware reasoning rather than trace-copying.
Get next week’s papers.
The same picks and the same summaries, in your inbox. Free, and 176 issues deep.
Subscribe on Substack