Checked fact 554020 Nov 2026Models and releases
Microsoft says that 92 of CyberGym-E2E's 905 tasks are based on the same open source projects and vulnerability reports as some of its training data, so it excluded them for every model and reports results on the remaining 813 tasks.
The exact words it rests on
Benchmark integrity: While reviewing our CyberGym‑E2E results, we found that 92 of the benchmark’s 905 tasks are based on the same open source projects and vulnerability reports as some of our training data. The benchmark’s reference solutions were never used in training. To be conservative, we excluded these 92 tasks for every model and report CyberGym‑E2E results on the remaining 813 tasks.
What the source said when we opened it, on 19 Nov 2026.
The source
MAI Cyber 2 Flash: Leading security. Lower cost
Checked
Checked by the notis newsroom on , against the source above.
In the story
MAI Code 2 arrives in GitHub Copilot, with Flash on the Free plan 20 Nov 2026
Cite this fact
Anyone may quote this address. It does not change; if we correct the story, this page says so.