OpsHarness, wrapping a general agent instead of rebuilding one
Free while signed in. Answers cite the passages they came from.

Haiyu Huang, Zhihan Jiang, Michael Lyu and coauthors show that a general agent like Codex or Claude Code now beats purpose-built RCA agents, and argue the remaining gap lives in the harness, which OpsHarness makes self-evolving.
General agents overtook specialized ones: The quantitative study finding is the framing move: stop rebuilding an agent from scratch and invest in the external adaptation layer around a modern general agent.
Data plane and control plane split: Layered operational knowledge plus an idea-card tool library on one side; setup, diagnosis, evolution and verification coordination on the other.
Evolution by contrastive trajectory mining: Successful and failed diagnoses are contrasted, converted into atomic proposals, and admitted only through dual-gate verification designed to prevent overfitting and regression.
59.0% top-1 accuracy: A 63.4% relative improvement over a bare general agent and 4.02x over baseline RCA agents, across two public benchmarks and an industrial deployment.
Abstract
Automated root cause analysis (RCA) with large language models (LLMs) has drawn growing attention. Today, SREs typically automate RCA with LLMs in one of two ways: directly using a general-purpose agent (e.g., Codex or Claude Code) for diagnosis, or building a specialized RCA agent from scratch. As mainstream general agents grow more capable and iterate quickly, our quantitative study finds that the former now often surpasses the latter. Its accuracy, however, still falls short of production needs, and this gap stems mainly from the external adaptation layer outside the agent's general capabilities, namely the harness. We therefore argue that LLM-based RCA should focus on this external harness, reusing the strong general capabilities of a modern agent rather than rebuilding an agent from scratch. A key capability of such a harness is to self-evolve, accumulating system-specific experience from past diagnoses so that it gets better the more it is used. We introduce OpsHarness, a self-evolving RCA harness that turns diagnosis experience into reusable expertise. Its data plane combines layered operational knowledge with an idea-card tool library, while its control plane coordinates setup, diagnosis, evolution, and verification. During evolution, OpsHarness contrasts successful and failed trajectories, converts their evidence into atomic proposals, and admits updates only through a dual-gate verification process designed to prevent overfitting and regression. Across two public benchmarks and an industrial deployment, OpsHarness achieves 59.0\% top-1 accuracy, improving over a bare general agent by 63.4\% and over baseline RCA agents by 4.02$\times$.
Get next week’s papers.
The same picks and the same summaries, in your inbox. Free, and 176 issues deep.
Subscribe on Substack