ainotis Join
My notis

Models

Every model our stories named. Each number links to its story and source. A dot means not checked yet.

All makers AlibabaAnthropicCanvaCloudflareElevenLabsGoogleH2O.aiLiquid AIMetaMicrosoftMicrosoft AIMiniMaxMistralMoonshot AINvidiaOpenAIReflection AISpaceXSIZ.ai
ModelMakerLatestPer million tokens, in / outContext Maker's own benchmarksMeasured by others
Claude Anthropic 15 Nov not checked yet not checked yet not checked yet not checked yet
Gemini Google 13 Nov not checked yet not checked yet not checked yet not checked yet
Gemini 4 Hydrogen Google 13 Nov $1.50 / $7.50 1,000,000 tokens Terminal-Bench 4.1, default high thinking level 57% · Artificial Analysis Intelligence Index, xhigh thinking level 54 points · Artificial Analysis Intelligence Index, default high thinking level 51 points not checked yet
Scribe ElevenLabs 13 Nov not checked yet not checked yet not checked yet not checked yet
H3-Image MiniMax 11 Nov not checked yet not checked yet not checked yet not checked yet
GPT-6 Cyber OpenAI 8 Nov not checked yet not checked yet ExploitGym Honeypot, out-of-scope services avoided, without deployment safety prompts 99.93% · ExploitGym 48.5% not checked yet
Kimi Moonshot AI 5 Nov not checked yet not checked yet not checked yet not checked yet
GPT OpenAI 3 Nov not checked yet not checked yet not checked yet not checked yet
Mistral Large Mistral 30 Oct not checked yet not checked yet not checked yet not checked yet
Muse Meta 30 Oct not checked yet not checked yet not checked yet not checked yet
Claude Mythos Anthropic 29 Oct not checked yet not checked yet not checked yet not checked yet
TimeH2O H2O.ai 29 Oct not checked yet not checked yet not checked yet not checked yet
GPT-2 OpenAI 28 Oct not checked yet not checked yet not checked yet not checked yet
Qwen Alibaba 27 Oct not checked yet not checked yet not checked yet not checked yet
Flora Nvidia 26 Oct not checked yet not checked yet not checked yet not checked yet
Kimi K3.1 Pro Moonshot AI 26 Oct not checked yet 1,000,000 tokens xdev-bench-hard pass@3 81% · Terminal-Bench 4.0 65.7% not checked yet
Voxtral Mistral 26 Oct not checked yet not checked yet not checked yet not checked yet
glm-5-3 Z.ai 26 Oct not checked yet not checked yet not checked yet StrongREJECT refusal rate, abliterated 12% · HarmBench refusal rate, abliterated 2% · JailbreakBench refusal rate, abliterated 3% · Binary Exploitation (Anthropic internal, 100 tasks) 4%
Craft Canva 23 Oct not checked yet not checked yet not checked yet not checked yet
Clairic Cloudflare 20 Oct not checked yet not checked yet not checked yet not checked yet
Nemotron Nvidia 20 Oct not checked yet 256,000 tokens not checked yet not checked yet
LaMDA Google 17 Oct not checked yet not checked yet not checked yet not checked yet
muse-spark-open Meta 16 Oct not checked yet 1,000,000 tokens MCP-Atlas (Meta's model card, xhigh) 89.2% · Terminal-Bench 2.1 (Meta's model card, xhigh) 76.4% · Artificial Analysis Intelligence Index (Meta's model card, xhigh) 39% not checked yet
Claude Haiku 5.5 Anthropic 15 Oct $0.50 / $2.50 1,000,000 tokens Anthropic political evenhandedness evaluation 99% · OSWorld 2.1, offline subset 72.4% not checked yet
Claude Opus 5.5 Anthropic 15 Oct $4 / $20 1,000,000 tokens Anthropic political evenhandedness evaluation 99% Terminal-Bench 4.0 (as reported by Moonshot) 66.4% · CheatBench cheating rate with Claude Code (lower is better) 11.2%
Claude Sonnet 5.5 Anthropic 15 Oct $2 / $10 not checked yet Anthropic political evenhandedness evaluation 99% · OSWorld 2.1, offline subset 83.9% · Terminal-Bench 4.0 70.6% not checked yet
Gemma Google 15 Oct not checked yet not checked yet not checked yet not checked yet
Grok Voice SpaceXSI 15 Oct not checked yet not checked yet not checked yet not checked yet
gemini-4-argon Google 15 Oct $4 / $20 not checked yet ERQA (Embodied Reasoning), pure reasoning 87% · Gray Swan Indirect Prompt Injection, attack success across 15 adaptive attempts (lower is better) 0.7% · shortcut or cheat attempts on coding benchmarks (lower is better) 2% · LVBench 91.7% · AutomationBench 51.3% · DeepSWE v1.1 77.9% not checked yet
GLM Z.ai 14 Oct not checked yet not checked yet not checked yet not checked yet
LFM2.5 Liquid AI 14 Oct not checked yet not checked yet not checked yet not checked yet
Muse Wonder Meta 13 Oct not checked yet not checked yet not checked yet not checked yet
Clef Cloudflare 12 Oct $0.24 / not checked yet not checked yet not checked yet not checked yet
Microsoft-Decision-1 Microsoft 12 Oct $0.042 / not checked yet not checked yet not checked yet not checked yet
Beam Reflection AI 11 Oct not checked yet not checked yet not checked yet not checked yet
GPT-6.1 Sol OpenAI 11 Oct $2 / $10 not checked yet not checked yet not checked yet
AlphaFold 10 Oct not checked yet not checked yet not checked yet not checked yet
GPT-6 Luna OpenAI 10 Oct $0.10 / $0.50 not checked yet OSWorld 2.1 (offline subset), on Anthropic's table 48.9% not checked yet
Claude Haiku 4.5 Anthropic 8 Oct $1 / $5 not checked yet OSWorld 2.1, offline subset 15.7% not checked yet
Mixtral Mistral 7 Oct not checked yet not checked yet not checked yet not checked yet
Nano Banana Google 7 Oct not checked yet not checked yet not checked yet not checked yet
MAI-Transcribe Microsoft AI 4 Oct not checked yet not checked yet not checked yet not checked yet
MAI-Voice Microsoft AI 4 Oct not checked yet not checked yet not checked yet not checked yet
claude-mythos-preview Anthropic 1 Oct not checked yet not checked yet Binary Exploitation (Anthropic internal, 100 tasks) 6% not checked yet
GPT-6 Astra OpenAI 30 Sep not checked yet not checked yet not checked yet CheatBench cheating rate with Codex (lower is better) 47.4% · UK AISI simulated supply-chain attack 29.2% · ProgramDistill cumulative workflows 49.2%
Claude Opus 5 Anthropic 28 Sep not checked yet not checked yet not checked yet ProgramDistill cumulative workflows 28.8%
GPT-6 Sol OpenAI 28 Sep $2 / $10 not checked yet not checked yet not checked yet
mmBERT 27 Sep not checked yet not checked yet not checked yet not checked yet
Sora OpenAI 24 Sep not checked yet not checked yet not checked yet not checked yet
Claude 3.7 Sonnet Anthropic not checked yet not checked yet SHADE-Arena overall sabotage success, Claude 3.6 Sonnet as monitor 27% not checked yet
Claude Fable 5.1 Anthropic $10 / $50 not checked yet not checked yet not checked yet
Claude Fable 5.2 Anthropic $8 / $40 not checked yet not checked yet not checked yet
Claude Mythos 5.2 Anthropic $8 / $40 not checked yet dedicated sandbox escape evaluation, credentials or files used outside the sandbox (Anthropic's own test) 3.1% not checked yet
Clef-flash Cloudflare $0.038 / not checked yet 24,000 tokens not checked yet not checked yet
Clef-omni Cloudflare $0.15 / not checked yet not checked yet not checked yet not checked yet
GPT-5.6 Cyber OpenAI not checked yet not checked yet ExploitGym Honeypot, out-of-scope services avoided, without deployment safety prompts 94.49% · ExploitGym 32.1% not checked yet
GPT-6.1 Terra OpenAI $1 / $5 not checked yet OpenAI internal error-inducing prompts, error rate at maximum effort (lower is better) 4.3% · OpenAI internal error-inducing prompts, error rate at low effort (lower is better) 16.7% · Terminal-Bench 4.0, maximum reasoning effort (OpenAI's own) 50.3% not checked yet
Gemini 2.5 Pro Google not checked yet not checked yet not checked yet SHADE-Arena monitoring AUC, benign vs malign transcripts 0.87% · SHADE-Arena overall sabotage success, Claude 3.6 Sonnet as monitor 15%
Gemini 3.8 Flash Google $1.50 / $7.50 not checked yet Terminal-Bench 4.1, as reported by Google in the Gemini 4 Hydrogen launch 18.2% CheatBench cheating rate with Gemini CLI (lower is better) 75.2%
Gemini 4 Carbon Google $4 / $20 not checked yet Gray Swan Indirect Prompt Injection Benchmark attack success rate 0% · Terminal-Bench 4.0 successful cheating 0% · WebDev Arena 1,768 points · CWE-bench 71% · ExploitGym 54.8% · SEC-bench Pro 88.2% · Artificial Analysis Intelligence Index v5.0 59 points not checked yet
Gemini Decision 1 Google $0.10 / not checked yet not checked yet not checked yet not checked yet
Grok 4.7 xAI not checked yet not checked yet not checked yet CheatBench cheating rate with Grok Build (lower is better) 78%
Grok Voice 3.0 not checked yet not checked yet not checked yet tau-Voice, as SpaceXSI reports it 71.6% · Artificial Analysis Speech-to-Speech Index, as SpaceXSI reports it 86.9 points
Mistral Large 4 Mistral $0.70 / $2.10 not checked yet Artificial Analysis Coding Agent Index 48% not checked yet
Muse Spark 1.3 Meta not checked yet not checked yet not checked yet CheatBench cheating rate with Muse Code (lower is better) 39%
Nano Banana 2 Google $0.50 / $60 not checked yet not checked yet not checked yet
Nano Banana 2.1 Google $1.50 / $30 not checked yet not checked yet not checked yet
Nemotron 3.5 Super VL Nvidia not checked yet not checked yet Hermes Bench 63.44% not checked yet
Scribe v3 ElevenLabs not checked yet not checked yet not checked yet not checked yet
Scribe v3 Live ElevenLabs not checked yet not checked yet not checked yet not checked yet

Maker's own: what a company measured on its own model, from its model card, system card or announcement. A claim about its own product, and labelled so.

Measured by others: a safety institute, a research group or a public benchmark run by someone other than the maker.

Prices for prompts over 100,000 tokens where a model has two tiers. Benchmarks come from each release's own documents, collected by the registrar.

Models

Every model our stories named. Each number links to its story and source. A dot means not checked yet.

All makers AlibabaAnthropicCanvaCloudflareElevenLabsGoogleH2O.aiLiquid AIMetaMicrosoftMicrosoft AIMiniMaxMistralMoonshot AINvidiaOpenAIReflection AISpaceXSIZ.ai

ModelMakerLatest in our stories Price per million tokens, in / outContext windowIndependent test results
Claude Anthropic 15 Nov · · ·
Gemini Google New model 13 Nov · · ·
Gemini 4 Hydrogen Google New model 13 Nov $1.50 / $7.50 1,000,000 tokens ·
Scribe ElevenLabs 13 Nov · · ·
H3-Image MiniMax 11 Nov · · ·
GPT-6 Cyber OpenAI 8 Nov · · ·
Kimi Moonshot AI 5 Nov · · ·
GPT OpenAI 3 Nov · · ·
Mistral Large Mistral 30 Oct · · ·
Muse Meta 30 Oct · · ·
Claude Mythos Anthropic 29 Oct · · ·
TimeH2O H2O.ai 29 Oct · · ·
GPT-2 OpenAI 28 Oct · · ·
Qwen Alibaba Safety finding 27 Oct · · ·
Flora Nvidia 26 Oct · · ·
Kimi K3.1 Pro Moonshot AI Safety finding 26 Oct · 1,000,000 tokens ·
Voxtral Mistral 26 Oct · · ·
glm-5-3 Z.ai 26 Oct · · StrongREJECT refusal rate, abliterated 12% · HarmBench refusal rate, abliterated 2% · JailbreakBench refusal rate, abliterated 3% · Binary Exploitation (Anthropic internal, 100 tasks) 4%
Craft Canva 23 Oct · · ·
Clairic Cloudflare New model 20 Oct · · ·
Nemotron Nvidia 20 Oct · 256,000 tokens ·
LaMDA Google 17 Oct · · ·
muse-spark-open Meta 16 Oct · 1,000,000 tokens ·
Claude Haiku 5.5 Anthropic 15 Oct $0.50 / $2.50 1,000,000 tokens ·
Claude Opus 5.5 Anthropic 15 Oct $4 / $20 1,000,000 tokens Terminal-Bench 4.0 (as reported by Moonshot) 66.4% · CheatBench cheating rate with Claude Code (lower is better) 11.2%
Claude Sonnet 5.5 Anthropic 15 Oct $2 / $10 · ·
Gemma Google 15 Oct · · ·
Grok Voice SpaceXSI 15 Oct · · ·
gemini-4-argon Google 15 Oct $4 / $20 · ·
GLM Z.ai 14 Oct · · ·
LFM2.5 Liquid AI 14 Oct · · ·
Muse Wonder Meta 13 Oct · · ·
Clef Cloudflare Price change 12 Oct $0.24 / · · ·
Microsoft-Decision-1 Microsoft New model 12 Oct $0.042 / · · ·
Beam Reflection AI 11 Oct · · ·
GPT-6.1 Sol OpenAI 11 Oct $2 / $10 · ·
AlphaFold · 10 Oct · · ·
GPT-6 Luna OpenAI 10 Oct $0.10 / $0.50 · ·
Claude Haiku 4.5 Anthropic 8 Oct $1 / $5 · ·
Mixtral Mistral 7 Oct · · ·
Nano Banana Google 7 Oct · · ·
MAI-Transcribe Microsoft AI 4 Oct · · ·
MAI-Voice Microsoft AI 4 Oct · · ·
claude-mythos-preview Anthropic 1 Oct · · ·
GPT-6 Astra OpenAI 30 Sep · · CheatBench cheating rate with Codex (lower is better) 47.4% · UK AISI simulated supply-chain attack 29.2% · ProgramDistill cumulative workflows 49.2%
Claude Opus 5 Anthropic Outside test 28 Sep · · ProgramDistill cumulative workflows 28.8%
GPT-6 Sol OpenAI Price change 28 Sep $2 / $10 · ·
mmBERT · 27 Sep · · ·
Sora OpenAI Retired 24 Sep · · ·
Claude 3.7 Sonnet Anthropic · · ·
Claude Fable 5.1 Anthropic $10 / $50 · ·
Claude Fable 5.2 Anthropic $8 / $40 · ·
Claude Mythos 5.2 Anthropic $8 / $40 · ·
Clef-flash Cloudflare $0.038 / · 24,000 tokens ·
Clef-omni Cloudflare $0.15 / · · ·
GPT-5.6 Cyber OpenAI · · ·
GPT-6.1 Terra OpenAI $1 / $5 · ·
Gemini 2.5 Pro Google · · SHADE-Arena monitoring AUC, benign vs malign transcripts 0.87% · SHADE-Arena overall sabotage success, Claude 3.6 Sonnet as monitor 15%
Gemini 3.8 Flash Google $1.50 / $7.50 · CheatBench cheating rate with Gemini CLI (lower is better) 75.2%
Gemini 4 Carbon Google $4 / $20 · ·
Gemini Decision 1 Google $0.10 / · · ·
Grok 4.7 xAI · · CheatBench cheating rate with Grok Build (lower is better) 78%
Grok Voice 3.0 · · · tau-Voice, as SpaceXSI reports it 71.6% · Artificial Analysis Speech-to-Speech Index, as SpaceXSI reports it 86.9 points
Mistral Large 4 Mistral $0.70 / $2.10 · ·
Muse Spark 1.3 Meta · · CheatBench cheating rate with Muse Code (lower is better) 39%
Nano Banana 2 Google $0.50 / $60 · ·
Nano Banana 2.1 Google $1.50 / $30 · ·
Nemotron 3.5 Super VL Nvidia · · ·
Scribe v3 ElevenLabs · · ·
Scribe v3 Live ElevenLabs · · ·