Agentic Context Engineering: Evolving Contexts for Self-Improving Language Models
Qizheng Zhang, Changran Hu, Shubhangi Upasani, Boyuan Ma, Fenglu Hong, Vamsidhar Kamanuru, Jay Rainton, Chen Wu, Mengmeng Ji, Hanchen Li, Urmish Thakker, James Zou, Kunle Olukotun
View Original →Abstract
Agentic Context Engineering (ACE) is a framework that optimizes contexts both offline (e.g., system prompts) and online (e.g., agent memory). ACE treats contexts as evolving playbooks that accumulate, refine, and organize strategies through a modular process of generation, reflection, and curation. Unlike methods that collapse prompts into short summaries and lose detail, ACE uses structured incremental updates that preserve knowledge and scale with long-context models. ACE consistently outperforms strong baselines: +10.6% on agent benchmarks and +8.6% on finance tasks, while significantly reducing adaptation latency and rollout cost.
Relevance to Tokalator
ACE provides theoretical grounding for Tokalator's optimization-first design philosophy: proactive context management yields measurable quality gains (+10.6%) compared to passive acceptance of whatever enters the context window. Tokalator's tab relevance scorer and /optimize command implement the context selection layer that ACE assumes as given.
Related Articles
Tokalator: A Context Engineering Toolkit for Artificial Intelligence Coding Assistants
We present Tokalator, an open-source context engineering toolkit that provides real-time token budget monitoring, 11 slash commands, quality modeling calculators, and cost analysis tools for AI coding assistants. Supporting 17 large language models across three providers, the toolkit includes a VS Code extension, CLI, and usage tracker. Survey findings reveal that instruction-file injection and low-relevance open tabs are among the primary invisible budget consumers.
Context Windows
Claude API Documentation
Long Context Window Tips
Comprehensive guide to prompt engineering techniques for Claude's latest models, covering clarity, examples, XML structuring, thinking, and agentic systems.
Long Context
Learn about how to get started building with long context (1 million context window) on Gemini.