Principles that Guide, Actions that Inform: Agent Evolution via Knowledge Abstraction

Bowen Ye, Wenzhao Li and colleagues (Alibaba Group, Shanghai Jiao Tong University) present SAGA, which turns agent trajectories into episodic descriptions, procedures and principles with explicit applicability conditions, and uses retrieved principles to correct candidate actions.
Ask this paper
Hierarchy. Experience is abstracted in three levels, episodic, procedural and principle, and each principle keeps links to the execution evidence it came from.
Action regulation. Retrieved principles are instantiated into task-specific guidance that checks candidate actions and triggers resampling when they conflict.
ScienceWorld. With DeepSeek-flash, the average score goes from 25.0% without memory and 54.8% with trajectory retrieval to 56.2%, and to 67.0% with Qwen3.8-Max. A Qwen2.5-7B trained with SFT and GRPO reaches 66.9%.
ALFWorld. Memory raises Qwen2.5-7B success from 45.5% to 57.5%, and Qwen3.8-Max reaches 99.3%. The SFT and GRPO model reaches 93.3%, and 96.3% with test-time adaptation.
Ablations. Contextual instantiation and action regulation account for most of the gain; swapping raw trajectories for episodic and procedural knowledge adds under one point.
Abstract
Large language model (LLM) agents have demonstrated strong capabilities in interactive environments, yet their ability to continually evolve from experience remains limited. Although fine-tuning enables adaptation, its dependence on parameter access and high computational costs restrict its flexibility, especially for large-scale and closed-source LLMs. External memory offers an alternative by allowing agents to accumulate experience without modifying model parameters. However, existing methods mainly focus on experience representation and organization, while the acquired knowledge remains tightly coupled with specific tasks and contexts, limiting generalization. A key challenge is how to transform concrete interactions into abstract and reusable knowledge that guides future decisions beyond individual experiences. To address this challenge, we propose SAGA (\underline{\textbf{S}}elf-evolving \underline{\textbf{A}}gents through Experience-\underline{\textbf{G}}rounded \underline{\textbf{A}}bstraction), a framework for experience-grounded knowledge abstraction and utilization in LLM agents. SAGA progressively transforms interaction trajectories into episodic descriptions, reusable procedures, and principles with explicit applicability conditions, while maintaining links to execution evidence. Retrieved principles are instantiated into task-specific guidance and used to refine candidate actions through corrective feedback and resampling. This creates an execution--abstraction feedback loop, where accumulated knowledge guides future interactions and new experiences continuously update hierarchical memory. Experiments on ScienceWorld and ALFWorld demonstrate improved task performance, with ablation studies highlighting the importance of contextual instantiation and action regulation for leveraging principle-level knowledge.