ainotis Join
My notis

Checked fact 554020 Nov 2026Models and releases

Microsoft says that 92 of CyberGym-E2E's 905 tasks are based on the same open source projects and vulnerability reports as some of its training data, so it excluded them for every model and reports results on the remaining 813 tasks.

The exact words it rests on

Benchmark integrity: While reviewing our CyberGym‑E2E results, we found that 92 of the benchmark’s 905 tasks are based on the same open source projects and vulnerability reports as some of our training data. The benchmark’s reference solutions were never used in training. To be conservative, we excluded these 92 tasks for every model and report CyberGym‑E2E results on the remaining 813 tasks.

What the source said when we opened it, on 19 Nov 2026.

The source

MAI Cyber 2 Flash: Leading security. Lower cost
Microsoft AI · 2026-11-17

Checked

Checked by the notis newsroom on , against the source above.

In the story

MAI Code 2 arrives in GitHub Copilot, with Flash on the Free plan 20 Nov 2026

Cite this fact

Anyone may quote this address. It does not change; if we correct the story, this page says so.