Protocol-Preserving Context Trimming for Agentic Workflows: Benefits, Failure Regimes, and Budget Guardrails
Harish Gaggar (Intuit Credit Karma) compares five context-trimming strategies for multi-step agent workflows and finds that preserving protocol-critical state matters more than the amount of text removed.
Ask this paper
Strategies compared: Recency, relevance, summarization, protocol-aware trimming and adaptive budget guardrails, measured on task success, protocol adherence, valid tool calls, token savings, latency and cascading failures.
Conventional trimming: About 60% token savings, but task success of only 66.6-77.3% and protocol adherence of 85.5-88.6%.
Protocol-aware and adaptive: Protocol-aware trimming raises task success to 92.2%; adaptive guardrails reach 96.0% success, 96.3% adherence and 1.0% cascading failure while still saving 56.0% of tokens.
Caveat: The protocol-aware condition protects state marked in two independent gold annotations, so it shows the value of knowing which state is critical; the paper does not name the model used, and data is available on request.
Budget threshold: Keeping 25% of context or less raises failure odds 10.92-fold against budgets of 50% or more, and the critical threshold rises with workflow complexity.
Abstract
Agentic large language model (LLM) systems rely on long interaction histories to preserve instructions, tool states, intermediate decisions, and unresolved dependencies, but unrestricted context growth increases computational cost and can reduce efficiency. This study evaluates protocol-preserving context trimming as a reliability-constrained approach for multi-step agentic workflows. Five trimming strategies - recency-based, relevance-based, summarization, protocol-aware trimming, and adaptive budget guardrails - were compared across retained-context levels and workflow-complexity classes using task success, protocol adherence, valid tool calls, token savings, latency reduction, cascading failures, and critical context thresholds. Conventional strategies achieved about 60% mean token savings but lower task success (66.6-77.3%) and protocol adherence (85.5-88.6%). Protocol-aware trimming improved task success to 92.2%, while adaptive guardrails achieved 96.0% task success, 96.3% protocol adherence, and 1.0% cascading failure with 56.0% mean token savings. Retained-context budgets of 25% or less increased failure odds 10.92-fold relative to budgets of 50% or more (p < 0.001). Protocol-aware trimming produced 5.24-fold greater odds of successful completion than conventional methods under aggressive budgets, while adaptive guardrails further increased success odds 2.11-fold versus fixed protocol-aware trimming (p < 0.001). Critical context thresholds also increased with workflow complexity. These findings indicate that reliable context reduction depends more on preserving protocol-critical state than on maximizing token removal, and that adaptive guardrails can improve efficiency, scalability, and reliability in long-horizon agentic systems.