🚀NEW COURSEVibe Coding AI Apps with Claude Code 🤖✨Enroll now
← All papers  /  Sep 13, 2026
Training

The Oligarch Barely Steers Model Collapse in Multi-Model Ecosystems

First page
The Oligarch Barely Steers Model Collapse in Multi-Model Ecosystems
The curator’s take

Yangze Liu and Zhongyi Han (Shandong University) test whether a dominant model in an oligopoly speeds up or steers model collapse when many models retrain on a shared pool, and find that market concentration changes neither the pace nor the destination much.

Ask this paper

Key points
01

Setup: 13 open 1 to 4B models form ecosystems of 3 to 13 players plus a probe that pushes the top share to 90%. Each generation, outputs are pooled by market share and every model retrains from clean base weights, for five generations.

02

Invariance: Making the split more unequal barely changes collapse speed, and share or identity changes move five-generation endpoints by only a few percent of the drift common to all arms.

03

What sets the pace: Membership does. With shares fixed, swapping members of a three-player ecosystem changes drift by 2.8x, and a share-weighted susceptibility index explains speed across 19 arms with R^2 = 0.68.

04

Human text: Replacing half the pool with human text roughly halves drift without changing its direction.

Abstract

AI-generated text is flowing back into the training corpora of the next generation of models. Recursive training on it drives model collapse, and recent work extends the setting to many models feeding one another -- but almost always with the market split evenly, while real generative AI is an oligopoly. Concentration raises two worries: fewer, more uniform sources may make collapse faster, and later models may be dragged toward the oligarch's output. We test both in controlled ecosystems: 13 open 1--4B models form natural ecosystems of 3 to 13 players, plus an injected probe that pushes the top share to 90%; each generation, every model's output is mixed into a shared pool by market share and every model is retrained on that pool from clean base weights, for five generations. Yet within the range we test, neither worry materializes; what emerges instead is an invariance. Making the split more unequal barely changes the speed of collapse. Destinations move even less: the share and identity knobs shift five-generation endpoints by only a few percent of the drift common to all arms -- the ecosystems collapse to nearly the same place. An extreme share paired with the strongest injected bias still does not guarantee steering, and the topic shifts it does produce leave only a faint trace on the ruler that measures collapse. What sets the speed is who supplies the pool and how readily those suppliers are carried along: with every share held fixed, swapping the members of a K=3 ecosystem changes five-generation drift by 2.8x; a share-weighted index of each member's susceptibility explains the speed differences across nineteen arms with R^2 = 0.68; and replacing half the pool with human text roughly halves drift without changing its course. Within the tested range, concentration sets neither the destination nor the pace of collapse; the pace follows whose text fills the pool.

Every Monday
Get next week’s papers.
Subscribe on Substack