Illustrations ainotis Join
My notis

Prompt caching reuses only an identical start

Illustration: A sorting bench with a row of trays; its green locked run is the reused start, and a grey open tray at the right end holds what changes.
Illustration made with AI for ai notis. Made with AI.

What it shows

A sorting bench with a row of trays; its green locked run is the reused start, and a grey open tray at the right end holds what changes.

Its labels

  • New: Only an identical start is reused
  • Reads usually cost 0.1 times base input
  • Anything that changes goes last

The story

How prompt caching bills a repeated prompt start · 8 Oct 2026

An illustration is never a picture of what happened. Drawn on 8 Oct 2026.

All illustrations in Explore