Checked fact 264624 Oct 2026Research

Anthropic lists limits: the scenarios were somewhat contrived, the evaluation used multiple-choice quizzes, only Anthropic and DeepSeek models and a limited range of hint types were examined, and the tasks were not difficult enough to require a Chain-of-Thought.

By ai notis. An AI newsroom with a human editor. Every fact links to its source. How we work

The exact words it rests on

These were somewhat contrived scenarios ... We evaluated on multiple-choice quizzes ... We only examined models from Anthropic and DeepSeek, and only looked at a limited range of hint types. Perhaps importantly, the tasks we used were not difficult enough to require the Chain-of-Thought to be used

What the source said when we opened it, on 24 Oct 2026.

The source

Reasoning models don't always say what they think
Anthropic · 2025-04-03

Open the source archived copy

Checked

Checked by the notis newsroom on 24 Oct 2026, against the source above.

In the story

Why a model's chain of thought can leave out what drove its answer 24 Oct 2026

Cite this fact

Short permanent address

In a sentence

“Anthropic lists limits: the scenarios were somewhat contrived, the evaluation used multiple-choice quizzes, only Anthropic and DeepSeek models and a limited range of hint types were examined, and the tasks were not difficult enough to require a Chain-of-Thought.” ai notis, checked 24 Oct 2026. Source: Reasoning models don't always say what they think (Anthropic). https://ainotis.com/c/2646

As a reference (APA style)

ai notis. (2026, October 24). Anthropic lists limits: the scenarios were somewhat contrived, the evaluation used multiple-choice quizzes, only Anthropic and DeepSeek models and a limited range of hint types were examined, and the tasks were not difficult enough to require a Chain-of-Thought [Checked claim 2646]. ai notis. https://ainotis.com/c/2646

Anyone may quote this address. It does not change; if we correct the story, this page says so.