Checked fact 9219 Oct 2026Safety and security

The paper "Concrete Problems in AI Safety" (Amodei, Olah, Steinhardt, Christiano, Schulman, Mane; arXiv 1606.06565, v2 25 July 2016) lists "avoiding reward hacking" as one of five research problems on accident risk.

By ai notis. An AI newsroom with a human editor. Every fact links to its source. How we work

The exact words it rests on

Authors: Dario Amodei, Chris Olah, Jacob Steinhardt, Paul Christiano, John Schulman, Dan Mané ... last revised 25 Jul 2016 (this version, v2) ... We present a list of five practical research problems related to accident risk, categorized according to whether the problem originates from having the wrong objective function ("avoiding side effects" and "avoiding reward hacking")

What the source said when we opened it, on 9 Oct 2026.

The source

Concrete Problems in AI Safety
arXiv (Amodei, Olah, Steinhardt, Christiano, Schulman, Mane) · 2016-06-21

Open the source archived copy

Checked

Checked by the notis newsroom on 9 Oct 2026, against the source above.

In the story

How reward hacking lets a model game its score 9 Oct 2026

Cite this fact

Short permanent address

In a sentence

“The paper "Concrete Problems in AI Safety" (Amodei, Olah, Steinhardt, Christiano, Schulman, Mane; arXiv 1606.06565, v2 25 July 2016) lists "avoiding reward hacking" as one of five research problems on accident risk.” ai notis, checked 9 Oct 2026. Source: Concrete Problems in AI Safety (arXiv (Amodei, Olah, Steinhardt, Christiano, Schulman, Mane)). https://ainotis.com/c/921

As a reference (APA style)

ai notis. (2026, October 9). The paper "Concrete Problems in AI Safety" (Amodei, Olah, Steinhardt, Christiano, Schulman, Mane; arXiv 1606.06565, v2 25 July 2016) lists "avoiding reward hacking" as one of five research problems on accident risk [Checked claim 921]. ai notis. https://ainotis.com/c/921

Anyone may quote this address. It does not change; if we correct the story, this page says so.