← All papers  /  Oct 15, 2026
Agents · Training

Athanor: An Agent-Native System for Autonomous Post-Training Research

First page
Athanor: An Agent-Native System for Autonomous Post-Training Research
The curator’s take

Yufa Zhou, Neiwen Ling, Zijun Wei and colleagues (ByteDance, Duke, UChicago, Virginia Tech) build Athanor, an open system in which frontier agents autonomously post-train a raw base model on real GPUs, and report that four Claude Opus 5.5 agents turned Qwen3-4B-Base into a model that matches the official Qwen3-4B-Instruct.

Ask this paper

Key points
01

System. Athanor provides frozen evaluation, managed GPU jobs, decontaminated data, a persistent research record and a held-out suite the agents never see. Agents have no external teacher models.

02

Campaign. Four agents, each on an eight-GPU node and given no research advice, ran for 104 hours.

03

Result. Qwen3-4B-Base went from 15.9 to 67.3 on the six-task development suite and from 9.2 to 48.2 on the held-out suite. The official Qwen3-4B-Instruct-2507 scores 66.5 and 47.9.

04

How they got there. The record shows recombination of known methods: SFT on public reasoning data, RL with a rollout change one agent introduced, weight merges across agents, and rounds of self-distillation.

05

Claim. With execution handled by the system, current agents already have the engineering and research skill to post-train a cross-domain generalist from a base model.

Abstract

Recursive self-improvement, in which AI systems build stronger AI systems, is one promising route to superintelligence. We study a weaker form that can be measured today: frontier agents post-training a small raw base model with public data, as a test of their research potential. We build Athanor, an open agent-native system for autonomous post-training research (AutoPostTrain) on real GPUs. We give the agents full research autonomy, low-friction engineering tools, and efficient starter code. The agents carry out the research themselves: they read datasets and evaluation results, build their training data, write and modify training algorithms, tune hyperparameters, and analyze the results to decide what to try next. They work in a sandbox and cannot use external teacher models. Athanor's services supply frozen evaluation, managed jobs, decontaminated data, a persistent research record, and a held-out suite the agents are unaware of. In a 104-hour campaign, a team of four Claude Opus 5.5 agents, each on an eight-GPU node and given no research advice, improves Qwen3-4B-Base from 15.9 to 67.3 on a six-task development suite and from 9.2 to 48.2 on a held-out suite, against 66.5 and 47.9 for the official Qwen3-4B-Instruct-2507. To our knowledge, this is the first demonstration that a team of frontier agents can autonomously post-train a raw base model into a cross-domain generalist model that matches or surpasses the official instruct version on average. The campaign's full record shows that the agents reach this level by recombining known methods and each other's models: SFT on public reasoning data, RL with a rollout change one agent introduced, weight merges across agents, and rounds of self-distillation. With execution handled, today's agents already have the engineering and research ability to conquer this task. We hope Athanor provides a foundation for scaling autonomous AI research.

Every Monday
Get next week’s papers.
Subscribe on Substack