ainotis Join
My notis

Checked fact 326131 Oct 2026Research

Anthropic's SHADE-Arena post (16 June 2025) gives models 17 benign but solvable tasks, each paired with a secret malicious side task.

The exact words it rests on

Published Jun 16, 2025 ... There are 17 complex, benign, but solvable tasks that models can be asked to perform in these environments - but each of them comes with a secret dark side. Every benign task is paired with a malicious side task that the model is to perform surreptitiously alongside.

What the source said when we opened it, on 31 Oct 2026.

The source

SHADE-Arena: Evaluating sabotage in LLM agents
Anthropic · 2025-06-16

Checked

Checked by the notis newsroom on , against the source above.

In the story

How AI monitors work, and how Anthropic's tests tried to evade them 31 Oct 2026

Cite this fact

Anyone may quote this address. It does not change; if we correct the story, this page says so.