Genie Generate a free company AI assistant Try it
← Back to Blog

OpenAI adds 12-hour caching for shared agent context

Editorial image for OpenAI adds 12-hour caching for shared agent context about AI Infrastructure.

Key Takeaways

  • OpenAI announced the option October 20; this October 26 article covers the prior week.
  • 12-hour writes cost 2.5× ordinary input, so longer coverage is not automatically cheaper.
  • At a 0.1× read rate, one write and two full reads beat three uncached prefix passes.
  • Test actual reuse against the default 30-minute lifetime before rolling out.
BLOOMIE
POWERED BY NEROVA

Produced by Bloomie for Nerova AI using automated editorial checks. Sources used for factual claims are listed below.

OpenAI added 12-hour prompt caching on October 20, 2026, allowing shared instructions, tools, and context to remain cached for requests hours apart. This catch-up report covers that announcement. The business question is whether repeated agent instructions earn back the higher cache-write cost.

What changed in the Responses API

For GPT-5.6 and later, set prompt_cache_options.ttl to "12h" in the Responses API; the default remains "30m". A content-block prompt_cache_breakpoint.ttl can override the request default. Earlier models use the separate prompt_cache_retention parameter; this is not a universal switch for every OpenAI model.

Our practical recommendation: consider longer coverage for a stable operating policy reused by morning, afternoon, and evening agent jobs—not for each job’s changing customer details.

The higher write cost changes the calculation

OpenAI documents total write rates of 2.5× ordinary input for 12 hours, versus 1.25× for 30 minutes; these are not additional surcharges. Reads cost 0.1× on most applicable models and 0.05× on GPT-6.1 Sol, regardless of lifetime.

Our calculation: normalize processing the shared prefix once without caching to one cost unit. At a 0.1× read rate, one 12-hour write plus one full read costs 2.6 units, more than two uncached passes. One write plus two full reads costs 2.7 units, less than three uncached passes. These ratios follow OpenAI’s published pricing relationships; they are not dollar quotes.

That conditional break-even assumes an unchanged prefix, successful full reads, and no rewrites. It does not establish that 12 hours beats 30 minutes: if shorter coverage keeps yielding hits, its cheaper initial write wins. Output, tools, and other workflow costs also remain outside this prefix-only calculation.

Limits to check before changing agent jobs

The documented minimum prefix is 1,024 visible input tokens. A 12-hour lifetime is neither a guaranteed cache hit nor a deletion deadline. Entries cannot be reused across organizations or regional processing boundaries; upgrading valid 30-minute coverage incurs a new 12-hour write without credit.

For rollout, we recommend testing the same scheduled jobs under both lifetimes. Compare actual cached tokens, writes by lifetime, and total cost—not simply the requested TTL. Keep longer coverage only where observed reuse justifies it; the October 20 announcement creates an option, not automatic savings.

Nerova context

Custom AI agents for business operations

Nerova builds custom AI agents for business operations. Companies use Nerova when they need AI support for customer intake, support, sales follow-up, research, website audits, internal handoffs, and workflow automation.

Nerova can help turn websites, business context, and operational workflows into practical AI systems: website chatbots, single-purpose agents, AI teams, audits, and automation workflows built around a clear business outcome.

Put AI agents to work

Explore Nerova’s AI team and see how to assign jobs, connect tools, and review requests.

Explore Nerova
Ask Bloomie about this article