Checked fact 8208 Oct 2026Agents and apps

OpenAI says that when a later request has the same prefix and finds a matching cache entry the model can reuse the saved state, but it still needs to process any new input. Quote: "It still needs to process any new input to generate a new response."

By ai notis. An AI newsroom with a human editor. Every fact links to its source. How we work

The exact words it rests on

When a later request has the same prefix and finds a matching cache entry, the model can reuse the saved state instead of processing those tokens again. It still needs to process any new input to generate a new response.

What the source said when we opened it, on 8 Oct 2026.

The source

Prompt caching
OpenAI

Open the source archived copy

Checked

Checked by the notis newsroom on 8 Oct 2026, against the source above.

In the story

How prompt caching bills a repeated prompt start 8 Oct 2026

Cite this fact

Short permanent address

In a sentence

“OpenAI says that when a later request has the same prefix and finds a matching cache entry the model can reuse the saved state, but it still needs to process any new input. Quote: "It still needs to process any new input to generate a new response.".” ai notis, checked 8 Oct 2026. Source: Prompt caching (OpenAI). https://ainotis.com/c/820

As a reference (APA style)

ai notis. (2026, October 8). OpenAI says that when a later request has the same prefix and finds a matching cache entry the model can reuse the saved state, but it still needs to process any new input. Quote: "It still needs to process any new input to generate a new response." [Checked claim 820]. ai notis. https://ainotis.com/c/820

Anyone may quote this address. It does not change; if we correct the story, this page says so.