Checked fact 42738 Nov 2026Research
METR's page says that for the majority of its tasks, humans attempt the task and it uses the geometric mean of their successful completion times; for some tasks it relies instead on expert estimates or QA completion times.
Toned down to what the source saysThe exact words it rests on
For the majority of our tasks, we estimate the duration it takes a human expert to complete the task by contracting humans to attempt the task and taking the geometric mean of their successful completion times. ... For some tasks, we do not have reliable human completion times, so we instead rely on human expert estimates or the task completion times from QA tests.
What the source said when we opened it, on 8 Nov 2026.
The source
Task-completion time horizons of frontier AI models
Checked
Checked by the notis newsroom on , against the source above.
In the story
How METR's time horizon rates AI agents by human task length 8 Nov 2026
Cite this fact
Anyone may quote this address. It does not change; if we correct the story, this page says so.