Back to blog

What breaks when your context window is a vendor decision?

Thắng Đoàn
Thắng Đoàn

You sized your agent workflows around a context window you do not control. Three vendor moves in one month show that number is a business decision, not an engineering constant.

The bottleneck moved into context

VentureBeat reports that production AI agents fail not because the models are wrong, but because the data underneath them is scattered, stale, and structured for humans rather than machines. Agents make orders of magnitude more data requests than human users, yet most retrieval layers were built for the human-scale, single-query problem. Context window: the text a model can hold in mind at once. The industry fix is architecture around the model, not a bigger model.

  • Context window: the text a model can hold in mind at once
  • The fix is architecture around the model, not a bigger model

Vendors are routing around the window

Per TechTimes, Anthropic's Claude Code Dynamic Workflows moves the orchestration plan out of the model's context window and into a JavaScript script Claude writes on the fly. That move determines whether very large multi-agent runs are feasible, and whether your next invoice is predictable. The trade is explicit: Anthropic itself flags that Dynamic Workflows consumes substantially more tokens than a normal session, and pricing at Opus levels can shift the bill dramatically.

Windows can shrink without warning

InfoWorld reports that OpenAI's update to the Codex CLI reduces the default configured input context window for GPT-5.6 to 272,000 tokens. The agent now compacts older code and conversation history sooner, and developers on Reddit and X argue this hurts long-running sessions on large repositories. OpenAI has not publicly explained the rationale. Picture a coding session where the agent suddenly re-reads files it just saw, because compaction silently dropped them.

  • Compaction: older context is summarized or dropped to fit
  • A silent default change can break your workflow overnight

What this does not solve

Scripted orchestration and external memory reduce pressure on the window, but they do not make agents reliably recall the right thing at the right time. Someone still must decide what context matters, and that choice now shifts cost and quality in ways vendors change without notice. None of these sources demonstrates the fixes work beyond vendor claims.

If your vendor silently shrank your context window tomorrow, which workflows would break first?
Which of your agent tasks truly need full context versus scripted orchestration or external memory?

Audit one production agent run today and list what it actually loads into context per step.

Sources

VentureBeat

TechTimes

InfoWorld

Share:

Recommended for you

Enjoyed this article?

Subscribe for new articles. No spam. Unsubscribe anytime.

By subscribing you agree to receive the newsletter. No spam, and you can unsubscribe anytime.