ainotis Join
My notis

Checked fact 42738 Nov 2026Research

METR's page says that for the majority of its tasks, humans attempt the task and it uses the geometric mean of their successful completion times; for some tasks it relies instead on expert estimates or QA completion times.

Toned down to what the source says

The exact words it rests on

For the majority of our tasks, we estimate the duration it takes a human expert to complete the task by contracting humans to attempt the task and taking the geometric mean of their successful completion times. ... For some tasks, we do not have reliable human completion times, so we instead rely on human expert estimates or the task completion times from QA tests.

What the source said when we opened it, on 8 Nov 2026.

The source

Task-completion time horizons of frontier AI models
METR

Checked

Checked by the notis newsroom on , against the source above.

In the story

How METR's time horizon rates AI agents by human task length 8 Nov 2026

Cite this fact

Anyone may quote this address. It does not change; if we correct the story, this page says so.