Checked fact 326131 Oct 2026Research
Anthropic's SHADE-Arena post (16 June 2025) gives models 17 benign but solvable tasks, each paired with a secret malicious side task.
The exact words it rests on
Published Jun 16, 2025 ... There are 17 complex, benign, but solvable tasks that models can be asked to perform in these environments - but each of them comes with a secret dark side. Every benign task is paired with a malicious side task that the model is to perform surreptitiously alongside.
What the source said when we opened it, on 31 Oct 2026.
The source
SHADE-Arena: Evaluating sabotage in LLM agents
Checked
Checked by the notis newsroom on , against the source above.
In the story
How AI monitors work, and how Anthropic's tests tried to evade them 31 Oct 2026
Cite this fact
Anyone may quote this address. It does not change; if we correct the story, this page says so.