---
title: How API Token Cache Pricing Works (And Why It Decides Your Real Bill)
url: "https://goremy.ai/blog/articles/how-api-token-cache-pricing-works-and-why-it-matters"
author: Luis Chavez-Mattos
editor: Luis Chavez-Mattos
editor_title: Director, Product
published: "2026-09-10T22:20:06.517Z"
updated: "2026-10-27T05:00:16.472Z"
topic: Cutting LLM Token Costs
description: "Anthropic cut Claude's cache-read price 75% without touching the sticker rate. Here's how token cache pricing works and why it decides your real AI bill."
---

# How API Token Cache Pricing Works (And Why It Decides Your Real Bill)

> Anthropic cut Claude's cache-read price 75% without touching the sticker rate. Here's how token cache pricing works and why it decides your real AI bill.

Edited by Luis Chavez-Mattos, Director, Product · Published 2026-09-10 · Updated 2026-10-27

## How does API token cache pricing work, and why does it decide your real bill?

API token caching lets a model reuse a previously processed chunk of a prompt instead of reprocessing it from scratch, and providers charge a fraction of the standard input rate for that reused chunk. The catch: this cache-read rate, not the advertised input or output price, is what actually determines your bill once you're running agents that resend growing context on every turn.

Anthropic's Claude Fable 5.1 release makes the point unusually well. The headline numbers look unchanged: $10 per million input tokens, $50 per million output tokens, identical to Fable 5. [1] But cache-read pricing dropped 75%, from $1.00 to $0.25 per million tokens. [1] [2] [3] Anthropic says that single line-item change cuts effective cost by roughly 25% for typical workloads and up to about 45% for heavily agentic ones, based on four weeks of real August 2026 usage data. [1] [4] Nothing on the pricing page looks different. The bill does.

**The Fable 5.1 Cache-Read Cut, By the Numbers**

- 75%: Cut to cache-read pricing
- $0.25: New cache-read rate per million tokens
- 45%: Max effective savings on heavily agentic workloads

## TL;DR

- Anthropic cut Claude Fable 5.1 **cache-read pricing by 75%** while keeping the standard input and output rates identical to Fable 5.
- For agents, the **cache-read rate** is the dominant cost driver because every turn resends a growing context.
- Cache-read discounts vary wildly across providers, from **zero to 98% off** standard input prices.
- The discount only applies when prefixes are **byte-identical**, so a timestamp or session ID in the cached portion can erase the savings.
- **SaaS vendors** capture cache savings on the back end, while teams building internal tools see direct bill cuts.
- A useful audit means finding the cache-read rate, checking your hit rate, and **measuring cost per task** instead of cost per token.

## How does prompt caching actually work?

Prompt caching lets a model store the computed state of a prompt prefix, the part of the input that stays the same call to call, so it doesn't have to reprocess that text from zero every time. [5] There are two charges to know, plus a rule that decides whether either one applies:

- **Cache writes.** The first time a prefix is cached, you pay a premium over standard input pricing, typically 1.25x for a short-lived cache and up to 2x for a longer-lived one on Anthropic's platform. [5] OpenAI charges 1.25x the standard input rate for a cache write as well. [6]
- **Cache reads.** Every subsequent call that reuses that same prefix pays a steeply discounted rate. On Anthropic's standard pricing, that's 10% of the base input price. [5] With Fable 5.1, it drops further, to 2.5% of base input. [5]
- **TTL and prefix matching.** Caches expire after a set window, five minutes or one hour on Anthropic's platform, and the discount only applies if the prefix is byte-identical to what was cached. Change a timestamp, reorder a tool definition, or alter a session ID, and the cache misses entirely. [7] [5]

The economics only work in your favor if a prefix gets reused enough times to amortize the write premium. Ask a model one question and cache it, and you've paid extra for nothing. Ask it forty questions against the same 150,000-token document, and the write cost becomes a rounding error next to what you save on the other thirty-nine reads.

## Why do cache reads, not input or output, run the bill for agents?

A one-shot chat query barely touches caching. You send a question, get an answer, done. An agent doesn't work that way. Every turn in an agent loop resends the accumulated transcript, the tool definitions, the system prompt, and whatever context has piled up so far, then appends the new turn on top. [7] Output stays comparatively small and flat. Input balloons with every step, and most of that input is the same prefix you sent last turn.

That's why the cache-read rate quietly becomes the dominant cost driver in agentic and internal-tool workloads, even though it's the line item almost nobody checks when comparing providers. Teams sizing up models by headline input/output price alone are pricing the wrong 90% of their actual token volume.

## What does a 75% cache-read cut actually buy you?

Merito ran the numbers on a realistic coding-agent setup: a 150,000-token cached prefix, hit 40 times in a session, producing 6 million cache-read tokens per session. [3] At the old $1.00 per million rate, that's $6.00. At the new $0.25 rate, it's $1.50, a 75% drop on that portion of the bill, matching the sticker cut exactly. [3]

Scale that to a real team: 50 engineers, 4 sessions a day, 20 working days a month, 4,000 sessions monthly. Cache-read spend alone falls from roughly $24,000 to about $6,000. [3] That's an $18,000 monthly swing driven entirely by a price change that never touched the input or output rate anyone would notice on a pricing page.

**Monthly Cache-Read Spend, 50-Engineer Team (4,000 Sessions/Month)**

| Cache-read pricing | Cache-read spend |
| --- | --- |
| Old rate ($1.00/M) | $24,000 |
| New rate ($0.25/M) | $6,000 |

The blended savings percentage Anthropic quotes, 25% to 45%, is just the cache-read share of the total bill multiplied by 0.75. [3] A workload where a third of tokens are cache reads saves about 25%. A workload where 60% of tokens are cache reads, typical of heavy agentic use, saves closer to 45%. The range isn't a marketing flourish. It's arithmetic on cache share.

## Are all cache discounts equal?

Here's where sticker-price comparisons get dangerous. Cache-read discounts vary wildly across the market:

- Claude Fable 5.1 now offers a 98% discount versus fresh input. [7] [8]
- gpt-oss-120b offers zero discount; cached tokens cost the same as fresh ones. [7]
- Most providers cluster around a 90% discount as the informal industry norm. [7] [8] [6]
- OpenAI's own cached-input discount sits at roughly 50%, notably smaller than Anthropic's structure. [9]

**Cache-Read Discount vs. Fresh Input, By Provider**

| Provider / model | Discount |
| --- | --- |
| Claude Fable 5.1 | 98% |
| Industry norm (typical) | 90% |
| OpenAI | 50% |
| gpt-oss-120b | 0% |

Two models can post identical headline input prices and produce very different real bills once you factor in how much traffic is cached and at what discount. Comparing two APIs on input/output rate alone, without checking the cache-read line, is comparing the wrong number, the same trap teams fall into when [routing agent workloads without checking what markup sits between them and raw compute](https://goremy.ai/blog/articles/hidden-costs-of-ai-agents-vs-apis-a-cost-breakdown).

## Why does this matter most for teams building their own tools?

SaaS subscribers never see this line item. Whatever caching economics the vendor captures on the back end, the customer pays a flat seat price regardless. [10] It's teams building internal agents directly on top of provider APIs, the shadow AI builders assembling their own tools with LLM calls, who are directly exposed to cache pricing and directly able to benefit from a cut like this one.

That exposure cuts both ways. A well-structured internal tool with stable prompt prefixes captures nearly all of a 75% cache-read cut automatically. A poorly structured one, where a timestamp or session token gets baked into the cached portion of every call, invalidates the cache on every single turn and pays full price regardless of what the provider's pricing page promises. [7] [5] The same nominal discount can be worth close to nothing depending on how carefully the prompt was engineered. That governance gap, where nobody is watching cost per task as a single request quietly multiplies into dozens of model calls, is exactly the kind of blind spot that shows up when employees [build their own AI tools without a budget owner watching the API bill](https://goremy.ai/blog/articles/how-to-reduce-llm-api-costs-5-methods-compared). [10]

## Build vs. buy: who actually captures the cache discount?

This is a build-vs-buy question dressed up as a pricing footnote. If you build your own integration, you own the cache-read line item and every optimization decision that shapes it: prefix stability, TTL choice, session structure. If you rent a SaaS wrapper over the same model, the vendor captures that 75% cut and decides whether any of it reaches your invoice. Given that [the intelligence inside most B2B software now costs pennies per million tokens](https://goremy.ai/blog/articles/why-is-b2b-saas-so-expensive-compared-to-ai-apis) while subscription prices haven't moved, there's little reason to assume the vendor is passing the savings through.

**Who Captures the Cache-Read Discount: Build vs. Buy**

| Option | Captures Cache-Read Savings | Control Over Prefix/TTL Design | Cache-Read Line-Item Visibility | Maintenance Burden |
| --- | --- | --- | --- | --- |
| Build on raw API (recommended) | high | high | high | high |
| Buy SaaS wrapper | low | low | low | low |

_Ratings are relative across these two options, not absolute scores._

Teams evaluating whether to run their own AI tooling on raw API access, rather than through a platform like [Remy](https://goremy.ai), should treat cache-read economics as a first-class line item in that decision, not an afterthought buried three rows down on a pricing page.

## How do you audit your own cache bill?

A few checks turn this from theory into a number you can act on:

1. **Find the cache-read rate.** It's a third price beyond input and output. If a vendor's pricing page doesn't list one, ask, because a missing line item doesn't mean a missing charge.
2. **Check your actual hit rate.** Most providers expose cache hit and miss counts in usage logs. A theoretical 90% discount is worthless if your prefixes rarely match.
3. **Keep prefixes byte-identical.** Move timestamps, session IDs, and dynamic content to the end of the prompt, after the cached portion, not inside it.
4. **Measure cost per task, not cost per token.** An agent that takes eight turns to finish a job and one that takes forty look identical on a per-token rate sheet but produce wildly different bills. [10]

The sticker price tells you what a provider wants you to compare. The cache-read rate, and how disciplined your prompts are about protecting it, tells you what you'll actually pay.

## Frequently Asked Questions

### What is API token cache pricing?

It's a separate, discounted rate providers charge when a model reuses a previously processed prompt prefix instead of reprocessing it from scratch. It sits alongside standard input and output pricing as a third rate, usually far cheaper than fresh input tokens.

### Why did Anthropic cut Claude Fable 5.1's cache-read price but not input or output pricing?

Anthropic left the headline $10/$50 input/output rates unchanged but cut the cache-read price 75%, from $1.00 to $0.25 per million tokens, because that line item is where most of the token volume in agentic workloads actually lands. [1] [2] [3]

### How much can prompt caching actually save on an AI API bill?

It depends entirely on what share of your tokens are cache reads. Anthropic estimates 25% savings for typical workloads and up to 45% for highly agentic ones under Fable 5.1's new pricing, since the savings equal roughly 75% of the cache-read share of the bill. [1] [3] [4]

### Do all AI providers offer the same cache discount?

No. Discounts range from 98% for Claude Fable 5.1 to 0% for gpt-oss-120b, with most providers clustering around a 90% discount as the informal norm and OpenAI offering roughly 50% on cached input. [7] [8] [9]

### Why does prompt caching matter more for AI agents than for chatbots?

Agent loops resend the entire accumulated transcript and tool definitions on every turn, so input volume, and the cache-read volume within it, grows with each step, while output stays comparatively flat. That makes the cache-read rate the dominant cost driver for agentic and internal-tool workloads. [7]

## Sources

1. [Claude Fable 5.1 and Mythos 5.1 (official announcement)](https://www.anthropic.com/claude-fable-and-mythos-5-1) (Anthropic)
2. [Anthropic's Claude Fable 5.1 and Mythos 5.1 arrive with a 75% cost reduction for Fable cache reads](https://venturebeat.com/technology/anthropics-claude-fable-5-1-and-mythos-5-1-arrive-with-a-75-cost-reduction-for-fable-cache-reads) (VentureBeat)
3. [What the Claude Fable 5.1 Cache Price Cut Actually Does to Your AI Bill](https://www.merito.com/resources/blogs/what-the-claude-fable-51-cache-price-cut-actually-does-to-your-ai-bill) (Merito)
4. [Claude on X: Cache reads with Fable 5.1 cost 75% less than Fable 5's](https://x.com/claudeai/status/2094848588190830982) (Anthropic (Claude/X))
5. [Prompt caching - Claude Platform Docs](https://platform.claude.com/docs/en/build-with-claude/prompt-caching) (Anthropic (Claude Platform Docs))
6. [Prompt caching | OpenAI API](https://developers.openai.com/api/docs/guides/prompt-caching) (OpenAI)
7. [Cache read discounts range from 98% to nothing at all: the price nobody compares](https://www.requesty.ai/blog/cache-read-price-comparison-across-providers) (Requesty)
8. [Prompt Caching: Cost & Performance Analysis Across Providers](https://artificialanalysis.ai/models/caching) (Artificial Analysis)
9. [OpenAI launches Prompt Caching which reduces cost by 50%](https://www.reddit.com/r/ClaudeAI/comments/1fvqqjk/openai_launches_prompt_caching_which_reduces_cost/) (Reddit (r/ClaudeAI), citing getbind.co comparison)
10. [The Agentic AI Boom Has a Bill Attached: How to Save Money While Building with AI](https://bhavishyapandit9.substack.com/p/the-agentic-ai-boom-has-a-bill-attached) (WTF In Tech (Substack))