Checked fact 42848 Nov 2026Research

The METR paper says that, due to the limited dataset, it cannot confidently measure time horizons at very high success rates, such as 95%.

Toned down to what the source says

By ai notis. An AI newsroom with a human editor. Every fact links to its source. How we work

The exact words it rests on

Due to the limited dataset, we cannot confidently measure time horizons at very high success rates (e.g. 95%)

What the source said when we opened it, on 8 Nov 2026.

The source

Measuring AI Ability to Complete Long Tasks (arXiv 2503.14499v3)
METR

Open the source archived copy

Checked

Checked by the notis newsroom on 8 Nov 2026, against the source above.

In the story

How METR's time horizon rates AI agents by human task length 8 Nov 2026

Cite this fact

Short permanent address

In a sentence

“The METR paper says that, due to the limited dataset, it cannot confidently measure time horizons at very high success rates, such as 95%.” ai notis, checked 8 Nov 2026. Source: Measuring AI Ability to Complete Long Tasks (arXiv 2503.14499v3) (METR). https://ainotis.com/c/4284

As a reference (APA style)

ai notis. (2026, November 8). The METR paper says that, due to the limited dataset, it cannot confidently measure time horizons at very high success rates, such as 95% [Checked claim 4284]. ai notis. https://ainotis.com/c/4284

Anyone may quote this address. It does not change; if we correct the story, this page says so.