Benchmarks / Artificial Analysis
Reported by Artificial Analysis
Artificial Analysis
Share of precise, checkable formatting instructions followed, as run by Artificial Analysis with its own harness and prompts.
- Results dated
- 1 Oct 2026
- Models
- 215
- Unit
- % of instructions
Full results
| # | Model | Artificial Analysis: IFBench % of instructions, higher is better |
|---|---|---|
| 1 | Grok 4.3 (medium)xAI |
83.3%
|
| 2 | grok-4.20-0309-reasoningxAI |
82.9%
|
| 3 | Grok 4.3 (high)xAI |
81.3%
|
| 4 | Grok 4.20xAI |
81.2%
|
| 5 | Grok 4.3 (low)xAI |
81.0%
|
| 6 | Qwen3.7 MaxAlibaba |
80.5%
|
| 7 | deepseek-v4-flash-preview (max reasoning)DeepSeek |
79.2%
|
| 8 | Qwen3.5 397B A17BAlibaba |
78.8%
|
| 9 | Qwen3.7 PlusAlibaba |
78.0%
|
| 9 | gemini-3-flash (thinking reasoning)Google |
78.0%
|
| 11 | GPT-5.2-Codex (xhigh)OpenAI |
77.6%
|
| 12 | Gemini 3.1 Flash Lite PreviewGoogle |
77.2%
|
| 13 | Gemini 3.1 Pro PreviewGoogle |
77.1%
|
| 14 | Qwen3.6 Max PreviewAlibaba |
76.6%
|
| 15 | deepseek-v4-pro-preview (max reasoning)DeepSeek |
76.5%
|
| 16 | Gemini 3.5 Flash (high)Google |
76.3%
|
| 17 | GLM 5.1Z.ai |
76.3%
|
| 18 | Kimi K2.6Moonshot AI |
76.0%
|
| 19 | muse-sparkMeta |
75.9%
|
| 19 | GPT-5.4 Nano (xhigh)OpenAI |
75.9%
|
| 21 | GPT-5.5 (xhigh reasoning)OpenAI |
75.8%
|
| 22 | Qwen3.5-122B-A10BAlibaba |
75.7%
|
| 23 | Qwen3.5-27BAlibaba |
75.6%
|
| 23 | Gemma 4 31BGoogle |
75.6%
|
| 25 | GPT-5.2 (xhigh)OpenAI |
75.4%
|
| 25 | GPT-5 Mini (high)OpenAI |
75.4%
|
| 27 | GPT-5.3-Codex (xhigh)OpenAI |
75.4%
|
| 28 | Qwen3.6 PlusAlibaba |
75.2%
|
| 29 | Gemini 3.5 Flash (medium)Google |
74.6%
|
| 30 | GPT-5-Codex (high)OpenAI |
74.2%
|
| 31 | GPT-5.4 (xhigh reasoning)OpenAI |
73.9%
|
| 32 | gemma-4-12b-itGoogle |
73.5%
|
| 33 | deepseek-v4-flash-preview (high reasoning)DeepSeek |
73.5%
|
| 34 | GLM 5.2 (max)Z.ai |
73.3%
|
| 35 | GPT-5.4 Mini (xhigh)OpenAI |
73.3%
|
| 36 | GLM 5 TurboZ.ai |
73.2%
|
| 37 | GPT-5 (high)OpenAI |
73.1%
|
| 38 | GPT-5.1 (high)OpenAI |
72.9%
|
| 39 | GPT-5.6 Sol (max)OpenAI |
72.7%
|
| 40 | Qwen3.5-35B-A3BAlibaba |
72.5%
|
| 41 | Gemma 4 26B A4BGoogle |
72.4%
|
| 42 | GLM 5Z.ai |
72.3%
|
| 43 | GPT-5.5 (high)OpenAI |
71.6%
|
| 44 | GPT-5.5 Instant (26 May)OpenAI |
71.5%
|
| 45 | deepseek-v4-pro-preview (high reasoning)DeepSeek |
71.3%
|
| 46 | GPT-5.6 Terra (max)OpenAI |
71.2%
|
| 47 | GPT-5 Mini (medium)OpenAI |
71.2%
|
| 48 | GPT-5.6 Sol (xhigh)OpenAI |
71.0%
|
| 49 | GPT-5.5 (medium reasoning)OpenAI |
71.0%
|
| 50 | Qwen3 Max ThinkingAlibaba |
70.7%
|
| 51 | GPT-5 (medium)OpenAI |
70.6%
|
| 52 | gemini-3-pro (high)Google |
70.4%
|
| 53 | Kimi K2.5Moonshot AI |
70.2%
|
| 54 | GPT-5.1-Codex (high)OpenAI |
70.0%
|
| 55 | GPT-5.6 Sol (medium reasoning)OpenAI |
69.6%
|
| 56 | GPT-5.6 Sol (high reasoning)OpenAI |
69.2%
|
| 57 | gpt-oss-120b (high)OpenAI |
69.0%
|
| 58 | Mistral Medium 3.5Mistral |
68.8%
|
| 59 | Kimi K2 ThinkingMoonshot AI |
68.1%
|
| 60 | GPT-5.1-Codex-Mini (high)OpenAI |
67.9%
|
| 60 | GLM 4.7Z.ai |
67.9%
|
| 62 | Qwen3.6 27BAlibaba |
67.6%
|
| 62 | GPT-5 Nano (high)OpenAI |
67.6%
|
| 64 | Qwen3.5-9BAlibaba |
66.7%
|
| 65 | GPT-5 (low reasoning)OpenAI |
66.6%
|
| 66 | GPT-5.6 Sol (low reasoning)OpenAI |
66.5%
|
| 67 | GPT-5.6 Terra (xhigh)OpenAI |
66.3%
|
| 68 | GPT-5.4 (low reasoning)OpenAI |
65.9%
|
| 68 | GPT-5 Nano (medium)OpenAI |
65.9%
|
| 70 | GPT-5.2 (medium reasoning)OpenAI |
65.2%
|
| 71 | gpt-oss-20b (high reasoning)OpenAI |
65.1%
|
| 72 | GPT-5.4 Mini (medium)OpenAI |
64.8%
|
| 73 | GPT-5.4 Nano (medium)OpenAI |
64.4%
|
| 73 | GPT-5.6 Terra (high reasoning)OpenAI |
64.4%
|
| 75 | Qwen3.6 35B A3BAlibaba |
64.4%
|
| 75 | GPT-5.5 (low reasoning)OpenAI |
64.4%
|
| 77 | deepseek-v3.2-specialeDeepSeek |
63.9%
|
| 78 | Claude Fable 5 (max reasoning)Anthropic |
63.5%
|
| 79 | Kimi K2.7 CodeMoonshot AI |
63.1%
|
| 80 | Claude Opus 4.8 (max reasoning)Anthropic |
62.2%
|
| 81 | GPT-5.6 Terra (medium reasoning)OpenAI |
62.2%
|
| 82 | GLM 5V TurboZ.ai |
61.1%
|
| 83 | GLM 4.7 FlashZ.ai |
60.8%
|
| 84 | Qwen3 Next 80B A3B ThinkingAlibaba |
60.7%
|
| 84 | DeepSeek V3.2DeepSeek |
60.7%
|
| 86 | GPT-5.6 Terra (low reasoning)OpenAI |
59.7%
|
| 87 | DiffusionGemma 26B A4BGoogle |
59.5%
|
| 88 | qwen3-vl-32b-thinkingAlibaba |
59.4%
|
| 89 | Claude Opus 4.7 (max reasoning)Anthropic |
58.6%
|
| 90 | gpt-oss-120b (low)OpenAI |
58.3%
|
| 91 | Claude Opus 4.5 (thinking reasoning)Anthropic |
58.0%
|
| 92 | gpt-oss-20b (low reasoning)OpenAI |
57.8%
|
| 93 | Claude Sonnet 4.5 (thinking reasoning)Anthropic |
57.3%
|
| 94 | DeepSeek V3.1 TerminusDeepSeek |
57.0%
|
| 95 | Claude Sonnet 4.6 (max reasoning)Anthropic |
56.6%
|
| 96 | Qwen3 VL 235B A22B ThinkingAlibaba |
56.5%
|
| 97 | Claude Opus 4.1 (thinking reasoning)Anthropic |
55.4%
|
| 98 | GLM 5 (no reasoning)Z.ai |
55.2%
|
| 99 | gemini-3-flash (off)Google |
55.1%
|
| 100 | GLM 4.7 (no reasoning)Z.ai |
54.6%
|
| 101 | Claude Haiku 4.5 (thinking reasoning)Anthropic |
54.3%
|
| 102 | DeepSeek V3.2 ExpDeepSeek |
54.1%
|
| 103 | Qwen3 Max Thinking (preview)Alibaba |
53.8%
|
| 104 | grok-4xAI |
53.7%
|
| 105 | Gemma 4 31B (off)Google |
53.5%
|
| 106 | Claude Opus 4.6 (max reasoning)Anthropic |
53.1%
|
| 107 | grok-4-1-fast-reasoningxAI |
52.7%
|
| 108 | gemini-2.5-flash-lite-preview-09-2025 (thinking reasoning)Google |
52.6%
|
| 109 | gemini-2.5-flash-preview-09-2025 (thinking reasoning)Google |
52.3%
|
| 110 | qwen3.5-4b (thinking reasoning)Alibaba |
52.0%
|
| 110 | GLM 5.1 (no reasoning)Z.ai |
52.0%
|
| 112 | Qwen3.5 397B A17B (no reasoning)Alibaba |
51.6%
|
| 113 | Qwen3 235B A22B Thinking 2507Alibaba |
51.2%
|
| 114 | Qwen3.5 Omni PlusAlibaba |
51.2%
|
| 115 | Qwen3.5-122B-A10B (no reasoning)Alibaba |
50.8%
|
| 116 | Qwen3 30B A3B Thinking 2507Alibaba |
50.7%
|
| 117 | grok-4-fast-reasoningxAI |
50.5%
|
| 118 | qwen3-4b-thinking-2507Alibaba |
49.8%
|
| 119 | gemini-3-pro (low)Google |
49.7%
|
| 120 | Grok 4.20 (off)xAI |
49.3%
|
| 121 | DeepSeek V3.2 (no reasoning)DeepSeek |
49.0%
|
| 122 | GPT-5.4 (no reasoning)OpenAI |
48.4%
|
| 123 | Mistral Small 4Mistral |
48.2%
|
| 124 | qwen3-max-previewAlibaba |
48.0%
|
| 125 | grok-4.20-0309-non-reasoning (no reasoning)xAI |
47.8%
|
| 126 | Grok 4.3 (off)xAI |
47.6%
|
| 127 | GPT-5.2 (no reasoning)OpenAI |
47.4%
|
| 128 | Gemini 3.5 Flash (minimal reasoning)Google |
47.3%
|
| 129 | deepseek-v4-flash-preview (no reasoning)DeepSeek |
47.2%
|
| 130 | Qwen3.5-27B (no reasoning)Alibaba |
46.9%
|
| 131 | GLM 4.7 Flash (no reasoning)Z.ai |
46.3%
|
| 132 | GPT-5.5 (no reasoning)OpenAI |
46.1%
|
| 133 | Qwen3 235B A22B Instruct 2507Alibaba |
46.1%
|
| 134 | deepseek-v4-pro-preview (no reasoning)DeepSeek |
45.8%
|
| 135 | Qwen3.6 27B (no reasoning)Alibaba |
45.7%
|
| 136 | GPT-5 Mini (minimal)OpenAI |
45.6%
|
| 136 | GPT-5 (minimal reasoning)OpenAI |
45.6%
|
| 138 | Gemma 4 26B A4B (off)Google |
45.4%
|
| 139 | gemma-4-12b-it (no reasoning)Google |
45.2%
|
| 140 | Qwen3 VL 30B A3B ThinkingAlibaba |
45.1%
|
| 141 | gpt-5-chatOpenAI |
45.0%
|
| 142 | Claude Opus 4.6 (off)Anthropic |
44.6%
|
| 143 | Qwen3.5-35B-A3B (no reasoning)Alibaba |
44.5%
|
| 144 | magistral-small-2509Mistral |
44.4%
|
| 145 | Kimi K2.6 (no reasoning)Moonshot AI |
44.3%
|
| 146 | gemma-4-e4b-itGoogle |
44.2%
|
| 147 | Qwen3 MaxAlibaba |
44.1%
|
| 148 | GLM 4.5Z.ai |
44.1%
|
| 149 | Kimi K2.5Moonshot AI |
43.7%
|
| 150 | Claude Opus 4.7 (off)Anthropic |
43.6%
|
| 151 | gemini-2.5-flash-preview-09-2025 (no reasoning)Google |
43.5%
|
| 152 | qwen3-omni-30b-a3b-thinkingAlibaba |
43.4%
|
| 152 | GLM 4.6 (thinking reasoning)Z.ai |
43.4%
|
| 154 | GPT-5.1 (off)OpenAI |
43.2%
|
| 155 | DeepSeek V3.2 Exp (no reasoning)DeepSeek |
43.1%
|
| 156 | Claude Opus 4.5 (no reasoning)Anthropic |
43.0%
|
| 156 | Magistral Medium 1.2Mistral |
43.0%
|
| 158 | Qwen3 VL 235B A22B InstructAlibaba |
42.7%
|
| 158 | Claude Sonnet 4.5 (no reasoning)Anthropic |
42.7%
|
| 160 | Claude Haiku 4.5 (no reasoning)Anthropic |
42.0%
|
| 161 | gemini-2.5-flash-lite-preview-09-2025 (no reasoning)Google |
41.8%
|
| 162 | Kimi K2 0905Moonshot AI |
41.7%
|
| 163 | DeepSeek V3.1DeepSeek |
41.5%
|
| 163 | Kimi K2 0711Moonshot AI |
41.5%
|
| 165 | Grok Code Fast 1xAI |
41.4%
|
| 166 | DeepSeek V3.1 Terminus (no reasoning)DeepSeek |
41.2%
|
| 167 | Claude Sonnet 4.6 (off)Anthropic |
41.2%
|
| 168 | gemma-4-e4b-it (no reasoning)Google |
40.5%
|
| 169 | Qwen3 Coder 480B A35BAlibaba |
40.5%
|
| 170 | Qwen3 VL 8B ThinkingAlibaba |
39.9%
|
| 171 | Mistral Medium 3.1Mistral |
39.8%
|
| 172 | Qwen3 Next 80B A3B InstructAlibaba |
39.7%
|
| 173 | Qwen3 VL 32B InstructAlibaba |
39.2%
|
| 174 | GPT-5.4 Mini (no reasoning)OpenAI |
38.8%
|
| 175 | Devstral 2 2512Mistral |
38.1%
|
| 176 | gemma-4-e2b-itGoogle |
38.0%
|
| 177 | Qwen3.5 Omni FlashAlibaba |
38.0%
|
| 178 | Qwen3.5-9B (no reasoning)Alibaba |
37.8%
|
| 178 | DeepSeek V3.1 (no reasoning)DeepSeek |
37.8%
|
| 180 | grok-4-fast-non-reasoning (no reasoning)xAI |
37.7%
|
| 181 | GLM 4.5 AirZ.ai |
37.6%
|
| 182 | GLM 4.6 (no reasoning)Z.ai |
36.7%
|
| 183 | qwen3-vl-4b-thinkingAlibaba |
36.6%
|
| 184 | grok-4-1-fast-non-reasoning (no reasoning)xAI |
36.5%
|
| 185 | Qwen3.6 35B A3B (no reasoning)Alibaba |
36.2%
|
| 185 | Mistral Large 3 2512Mistral |
36.2%
|
| 187 | Qwen3 Coder NextAlibaba |
35.2%
|
| 188 | Devstral Small 1.1Mistral |
34.6%
|
| 189 | GLM 4.5V (thinking reasoning)Z.ai |
34.2%
|
| 190 | gemma-4-e2b-it (no reasoning)Google |
33.6%
|
| 191 | qwen3-4b-instruct-2507Alibaba |
33.5%
|
| 192 | qwen3.5-4b (no reasoning)Alibaba |
33.3%
|
| 193 | Qwen3 VL 30B A3B InstructAlibaba |
33.1%
|
| 194 | Qwen3 30B A3B Instruct 2507Alibaba |
33.1%
|
| 195 | Mistral Small 4 (no reasoning)Mistral |
32.8%
|
| 196 | GPT-5.4 Nano (no reasoning)OpenAI |
32.7%
|
| 197 | Qwen3 Coder 30B A3B InstructAlibaba |
32.7%
|
| 198 | GPT-5 Nano (minimal)OpenAI |
32.5%
|
| 199 | Qwen3 VL 8B InstructAlibaba |
32.3%
|
| 200 | Ministral 3 14B 2512Mistral |
32.0%
|
| 201 | qwen3-vl-4b-instructAlibaba |
31.8%
|
| 202 | qwen3.5-2b (thinking reasoning)Alibaba |
31.5%
|
| 203 | Qwen3 Omni 30B A3B InstructAlibaba |
31.2%
|
| 203 | devstral-small-2-24b-instruct-2512Mistral |
31.2%
|
| 205 | GLM 4.6V (thinking reasoning)Z.ai |
30.1%
|
| 206 | Devstral MediumMistral |
29.9%
|
| 207 | qwen3.5-2b (no reasoning)Alibaba |
29.1%
|
| 207 | Ministral 3 8B 2512Mistral |
29.1%
|
| 209 | GLM 4.5V (off)Z.ai |
28.6%
|
| 210 | kimi-linear-48b-a3b-instructMoonshot AI |
28.1%
|
| 211 | GLM 4.6V (no reasoning)Z.ai |
27.9%
|
| 212 | Ministral 3 3B 2512Mistral |
26.8%
|
| 213 | qwen3.5-0.8b (no reasoning)Alibaba |
21.6%
|
| 214 | qwen3.5-0.8b (thinking reasoning)Alibaba |
21.5%
|
| 215 | Gemma 3 270MGoogle |
12.1%
|
Results as published by Artificial Analysis; we do not re-run them.
What it measures
Share of precise, checkable formatting instructions followed, as run by Artificial Analysis with its own harness and prompts.
What it does not measure
Not judgement about what an instruction meant.
Source
Failures
Failures count against a model: a product with no usable output is a failed listing. They are listed here so you can see why.
Not ranked
- Command A: creator outside the providers the catalogue covers
- GPT-4 Turbo: released before 2025-07-01
- GPT-4o (2024-05-13): released before 2025-07-01
- GPT-4o (2024-08-06): released before 2025-07-01
- Hy3: creator outside the providers the catalogue covers
- Hy3 preview: creator outside the providers the catalogue covers
- Inkling: creator outside the providers the catalogue covers
- Inkling Small: creator outside the providers the catalogue covers
- Llama 4 Maverick: released before 2025-07-01
- Llama 4 Scout: released before 2025-07-01
- Mercury 2: creator outside the providers the catalogue covers
- MiniMax M2: creator outside the providers the catalogue covers
- MiniMax M3: creator outside the providers the catalogue covers
- Mistral Large 2407: released before 2025-07-01
- Mistral Medium 3: released before 2025-07-01
- Phi 4: creator outside the providers the catalogue covers
- QwQ-32B-Preview: released before 2025-07-01
- R1: released before 2025-07-01
- Reka Flash 3: creator outside the providers the catalogue covers
- Solar Pro 3: creator outside the providers the catalogue covers
- Solar Pro 4: creator outside the providers the catalogue covers
- Trinity Large Thinking: creator outside the providers the catalogue covers
- a-x-k2: creator outside the providers the catalogue covers
- apertus-70b-instruct: creator outside the providers the catalogue covers
- apertus-8b-instruct: creator outside the providers the catalogue covers
- apodex-1-1: creator outside the providers the catalogue covers
- apriel-v1-5-15b-thinker: creator outside the providers the catalogue covers
- apriel-v1-6-15b-thinker: creator outside the providers the catalogue covers
- arctic-instruct: creator outside the providers the catalogue covers
- celeris-1: creator outside the providers the catalogue covers
- claude-2: released before 2025-07-01
- claude-21: released before 2025-07-01
- claude-3-5-haiku: released before 2025-07-01
- claude-3-7-sonnet: released before 2025-07-01
- claude-3-7-sonnet-thinking: released before 2025-07-01
- claude-3-haiku: released before 2025-07-01
- claude-3-opus: released before 2025-07-01
- claude-3-sonnet: released before 2025-07-01
- claude-35-sonnet: released before 2025-07-01
- claude-35-sonnet-june-24: released before 2025-07-01
- claude-4-opus: released before 2025-07-01
- claude-4-opus-thinking: released before 2025-07-01
- claude-4-sonnet: released before 2025-07-01
- claude-4-sonnet-thinking: released before 2025-07-01
- claude-instant: released before 2025-07-01
- claude-sonnet-4-6-non-reasoning-low-effort: non-standard setting combination
- cogito-v2-1-reasoning: creator outside the providers the catalogue covers
- command-a-plus: creator outside the providers the catalogue covers
- command-r-03-2024: creator outside the providers the catalogue covers
- command-r-plus-04-2024: creator outside the providers the catalogue covers
- dbrx: creator outside the providers the catalogue covers
- deephermes-3-llama-3-1-8b-preview: creator outside the providers the catalogue covers
- deephermes-3-mistral-24b-preview: creator outside the providers the catalogue covers
- deepseek-coder-v2: released before 2025-07-01
- deepseek-coder-v2-lite: released before 2025-07-01
- deepseek-llm-67b-chat: released before 2025-07-01
- deepseek-r1-0120: released before 2025-07-01
- deepseek-r1-distill-llama-70b: released before 2025-07-01
- deepseek-r1-distill-llama-8b: released before 2025-07-01
- deepseek-r1-distill-qwen-1-5b: released before 2025-07-01
- deepseek-r1-distill-qwen-14b: released before 2025-07-01
- deepseek-r1-distill-qwen-32b: released before 2025-07-01
- deepseek-r1-qwen3-8b: released before 2025-07-01
- deepseek-v2: released before 2025-07-01
- deepseek-v2-5: released before 2025-07-01
- deepseek-v2-5-sep-2024: released before 2025-07-01
- deepseek-v3: released before 2025-07-01
- deepseek-v3-0324: released before 2025-07-01
- devstral-small-2505: released before 2025-07-01
- doubao-seed-code: creator outside the providers the catalogue covers
- ernie-4-5-300b-a47b: creator outside the providers the catalogue covers
- ernie-5-0-thinking-preview: creator outside the providers the catalogue covers
- exaone-4-0-1-2b: creator outside the providers the catalogue covers
- exaone-4-0-1-2b-reasoning: creator outside the providers the catalogue covers
- exaone-4-0-32b: creator outside the providers the catalogue covers
- exaone-4-0-32b-reasoning: creator outside the providers the catalogue covers
- exaone-4-5-33b: creator outside the providers the catalogue covers
- falcon-h1r-7b: creator outside the providers the catalogue covers
- g9v3-39a5b: creator outside the providers the catalogue covers
- g9v3-3b: creator outside the providers the catalogue covers
- gemini-1-0-pro: released before 2025-07-01
- gemini-1-0-ultra: released before 2025-07-01
- gemini-1-5-flash: released before 2025-07-01
- gemini-1-5-flash-8b: released before 2025-07-01
- gemini-1-5-flash-may-2024: released before 2025-07-01
- gemini-1-5-pro: released before 2025-07-01
- gemini-1-5-pro-may-2024: released before 2025-07-01
- gemini-2-0-flash: released before 2025-07-01
- gemini-2-0-flash-experimental: released before 2025-07-01
- gemini-2-0-flash-lite-001: released before 2025-07-01
- gemini-2-0-flash-lite-preview: released before 2025-07-01
- gemini-2-0-flash-thinking-exp-0121: released before 2025-07-01
- gemini-2-0-flash-thinking-exp-1219: released before 2025-07-01
- gemini-2-0-pro-experimental-02-05: released before 2025-07-01
- gemini-2-5-flash: released before 2025-07-01
- gemini-2-5-flash-04-2025: released before 2025-07-01
- gemini-2-5-flash-lite: released before 2025-07-01
- gemini-2-5-flash-lite-reasoning: released before 2025-07-01
- gemini-2-5-flash-reasoning: released before 2025-07-01
- gemini-2-5-flash-reasoning-04-2025: released before 2025-07-01
- gemini-2-5-pro: released before 2025-07-01
- gemini-2-5-pro-03-25: released before 2025-07-01
- gemini-2-5-pro-05-06: released before 2025-07-01
- gemma-3-12b: released before 2025-07-01
- gemma-3-1b: released before 2025-07-01
- gemma-3-27b: released before 2025-07-01
- gemma-3-4b: released before 2025-07-01
- gemma-3n-e2b: released before 2025-07-01
- gemma-3n-e4b: released before 2025-07-01
- gemma-3n-e4b-preview-0520: released before 2025-07-01
- gpt-35-turbo: released before 2025-07-01
- gpt-4: released before 2025-07-01
- gpt-4-1: released before 2025-07-01
- gpt-4-1-mini: released before 2025-07-01
- gpt-4-1-nano: released before 2025-07-01
- gpt-4-5: released before 2025-07-01
- gpt-4o: released before 2025-07-01
- gpt-4o-chatgpt: released before 2025-07-01
- gpt-4o-chatgpt-03-25: released before 2025-07-01
- gpt-4o-mini: released before 2025-07-01
- granite-3-3-8b-instruct: creator outside the providers the catalogue covers
- granite-4-0-350m: creator outside the providers the catalogue covers
- granite-4-0-h-350m: creator outside the providers the catalogue covers
- granite-4-0-h-nano-1b: creator outside the providers the catalogue covers
- granite-4-0-h-small: creator outside the providers the catalogue covers
- granite-4-0-micro: creator outside the providers the catalogue covers
- granite-4-0-nano-1b: creator outside the providers the catalogue covers
- granite-4-1-30b: creator outside the providers the catalogue covers
- granite-4-1-3b: creator outside the providers the catalogue covers
- granite-4-1-8b: creator outside the providers the catalogue covers
- granite-4-2-30b: creator outside the providers the catalogue covers
- granite-4-2-3b: creator outside the providers the catalogue covers
- granite-4-2-8b: creator outside the providers the catalogue covers
- grok-1: released before 2025-07-01
- grok-2-1212: released before 2025-07-01
- grok-3: released before 2025-07-01
- grok-3-mini-reasoning: released before 2025-07-01
- grok-3-reasoning: released before 2025-07-01
- grok-beta: released before 2025-07-01
- hermes-3-llama-3-1-70b: creator outside the providers the catalogue covers
- hermes-4-llama-3-1-405b: creator outside the providers the catalogue covers
- hermes-4-llama-3-1-405b-reasoning: creator outside the providers the catalogue covers
- hermes-4-llama-3-1-70b: creator outside the providers the catalogue covers
- hermes-4-llama-3-1-70b-reasoning: creator outside the providers the catalogue covers
- hy3-non-reasoning: creator outside the providers the catalogue covers
- hyperclova-x-seed-think-32b: creator outside the providers the catalogue covers
- hypernova-60b: creator outside the providers the catalogue covers
- intellect-3: creator outside the providers the catalogue covers
- jamba-1-5-large: creator outside the providers the catalogue covers
- jamba-1-5-mini: creator outside the providers the catalogue covers
- jamba-1-6-large: creator outside the providers the catalogue covers
- jamba-1-6-mini: creator outside the providers the catalogue covers
- jamba-1-7-large: creator outside the providers the catalogue covers
- jamba-1-7-mini: creator outside the providers the catalogue covers
- jamba-reasoning-3b: creator outside the providers the catalogue covers
- jt-35b-flash: creator outside the providers the catalogue covers
- jt-4-1-flash-236b-a21b: creator outside the providers the catalogue covers
- jt-mini: creator outside the providers the catalogue covers
- jt236b: creator outside the providers the catalogue covers
- k-exaone: creator outside the providers the catalogue covers
- k-exaone-2-0-0803: creator outside the providers the catalogue covers
- k-exaone-non-reasoning: creator outside the providers the catalogue covers
- k2-horizon-0-9b: creator outside the providers the catalogue covers
- k2-horizon-3-7b: creator outside the providers the catalogue covers
- k2-horizon-375b-a23b: creator outside the providers the catalogue covers
- k2-horizon-7b: creator outside the providers the catalogue covers
- k2-horizon-mova-36b-a4b: creator outside the providers the catalogue covers
- k2-think-v2: creator outside the providers the catalogue covers
- k2-v2: creator outside the providers the catalogue covers
- k2-v2-low: creator outside the providers the catalogue covers
- k2-v2-medium: creator outside the providers the catalogue covers
- kat-coder-pro-v1: creator outside the providers the catalogue covers
- kat-coder-pro-v2: creator outside the providers the catalogue covers
- lfm-40b: creator outside the providers the catalogue covers
- lfm2-1-2b: creator outside the providers the catalogue covers
- lfm2-2-6b: creator outside the providers the catalogue covers
- lfm2-24b-a2b: creator outside the providers the catalogue covers
- lfm2-5-1-2b-instruct: creator outside the providers the catalogue covers
- lfm2-5-1-2b-thinking: creator outside the providers the catalogue covers
- lfm2-5-2-6b: creator outside the providers the catalogue covers
- lfm2-5-8b-a1b: creator outside the providers the catalogue covers
- lfm2-5-vl-1-6b: creator outside the providers the catalogue covers
- lfm2-8b-a1b: creator outside the providers the catalogue covers
- ling-1t: creator outside the providers the catalogue covers
- ling-2-6-1t: creator outside the providers the catalogue covers
- ling-2-6-flash: creator outside the providers the catalogue covers
- ling-3-0-flash: creator outside the providers the catalogue covers
- ling-3-0-flash-fin: creator outside the providers the catalogue covers
- ling-3-0-flash-vl: creator outside the providers the catalogue covers
- ling-3-0-tiny: creator outside the providers the catalogue covers
- ling-flash-2-0: creator outside the providers the catalogue covers
- ling-mini-2-0: creator outside the providers the catalogue covers
- llama-2-chat-13b: released before 2025-07-01
- llama-2-chat-70b: released before 2025-07-01
- llama-2-chat-7b: released before 2025-07-01
- llama-3-1-instruct-405b: released before 2025-07-01
- llama-3-1-instruct-70b: released before 2025-07-01
- llama-3-1-instruct-8b: released before 2025-07-01
- llama-3-1-nemotron-instruct-70b: creator outside the providers the catalogue covers
- llama-3-1-nemotron-nano-4b-reasoning: creator outside the providers the catalogue covers
- llama-3-1-nemotron-ultra-253b-v1-reasoning: creator outside the providers the catalogue covers
- llama-3-2-instruct-11b-vision: released before 2025-07-01
- llama-3-2-instruct-1b: released before 2025-07-01
- llama-3-2-instruct-3b: released before 2025-07-01
- llama-3-2-instruct-90b-vision: released before 2025-07-01
- llama-3-3-instruct-70b: released before 2025-07-01
- llama-3-3-nemotron-super-49b: creator outside the providers the catalogue covers
- llama-3-3-nemotron-super-49b-reasoning: creator outside the providers the catalogue covers
- llama-3-instruct-70b: released before 2025-07-01
- llama-3-instruct-8b: released before 2025-07-01
- llama-65b: released before 2025-07-01
- llama-nemotron-super-49b-v1-5: creator outside the providers the catalogue covers
- llama-nemotron-super-49b-v1-5-reasoning: creator outside the providers the catalogue covers
- longcat-2-0: creator outside the providers the catalogue covers
- longcat-flash-lite: creator outside the providers the catalogue covers
- magistral-medium: released before 2025-07-01
- magistral-small: released before 2025-07-01
- mercury-2-5: creator outside the providers the catalogue covers
- mi-dm-k-2-5-pro-dec28: creator outside the providers the catalogue covers
- midm-250-pro-rsnsft: creator outside the providers the catalogue covers
- mimo-v2-0206: creator outside the providers the catalogue covers
- mimo-v2-5-0424: creator outside the providers the catalogue covers
- mimo-v2-5-pro: creator outside the providers the catalogue covers
- mimo-v2-5-pro-non-reasoning: creator outside the providers the catalogue covers
- mimo-v2-6-flash: creator outside the providers the catalogue covers
- mimo-v2-6-pro: creator outside the providers the catalogue covers
- mimo-v2-flash: creator outside the providers the catalogue covers
- mimo-v2-flash-reasoning: creator outside the providers the catalogue covers
- mimo-v2-omni: creator outside the providers the catalogue covers
- mimo-v2-omni-0327: creator outside the providers the catalogue covers
- mimo-v2-pro: creator outside the providers the catalogue covers
- minicpm-v4-6-1-3b: creator outside the providers the catalogue covers
- minicpm5-1b: creator outside the providers the catalogue covers
- minicpm5-1b-non-reasoning: creator outside the providers the catalogue covers
- minicpm5-2b: creator outside the providers the catalogue covers
- minimax-m1-40k: creator outside the providers the catalogue covers
- minimax-m1-80k: creator outside the providers the catalogue covers
- minimax-m2-1: creator outside the providers the catalogue covers
- minimax-m2-5: creator outside the providers the catalogue covers
- minimax-m2-7: creator outside the providers the catalogue covers
- mistral-7b-instruct: released before 2025-07-01
- mistral-8x22b-instruct: released before 2025-07-01
- mistral-large: released before 2025-07-01
- mistral-large-2: released before 2025-07-01
- mistral-medium: released before 2025-07-01
- mistral-saba: released before 2025-07-01
- mistral-small: released before 2025-07-01
- mistral-small-2402: released before 2025-07-01
- mistral-small-3: released before 2025-07-01
- mistral-small-3-1: released before 2025-07-01
- mistral-small-3-2: released before 2025-07-01
- mixtral-8x7b-instruct: released before 2025-07-01
- molmo-7b-d: creator outside the providers the catalogue covers
- molmo2-8b: creator outside the providers the catalogue covers
- motif-0714: creator outside the providers the catalogue covers
- motif-2-12-7b: creator outside the providers the catalogue covers
- motif-3: creator outside the providers the catalogue covers
- nanbeige4-1-3b: creator outside the providers the catalogue covers
- nemotron-3-5-lightning: creator outside the providers the catalogue covers
- nemotron-3-nano-omni-30b-a3b: creator outside the providers the catalogue covers
- nemotron-cascade-2-30b-a3b: creator outside the providers the catalogue covers
- nex-n2-pro: creator outside the providers the catalogue covers
- north-mini-code: creator outside the providers the catalogue covers
- nova-2-0-lite: creator outside the providers the catalogue covers
- nova-2-0-lite-reasoning: creator outside the providers the catalogue covers
- nova-2-0-lite-reasoning-low: creator outside the providers the catalogue covers
- nova-2-0-lite-reasoning-medium: creator outside the providers the catalogue covers
- nova-2-0-omni: creator outside the providers the catalogue covers
- nova-2-0-omni-reasoning-low: creator outside the providers the catalogue covers
- nova-2-0-omni-reasoning-medium: creator outside the providers the catalogue covers
- nova-2-0-pro: creator outside the providers the catalogue covers
- nova-2-0-pro-reasoning-low: creator outside the providers the catalogue covers
- nova-2-0-pro-reasoning-medium: creator outside the providers the catalogue covers
- nova-lite: creator outside the providers the catalogue covers
- nova-micro: creator outside the providers the catalogue covers
- nova-premier: creator outside the providers the catalogue covers
- nova-pro: creator outside the providers the catalogue covers
- nvidia-nemotron-3-nano-30b-a3b: creator outside the providers the catalogue covers
- nvidia-nemotron-3-nano-30b-a3b-reasoning: creator outside the providers the catalogue covers
- nvidia-nemotron-3-nano-4b: creator outside the providers the catalogue covers
- nvidia-nemotron-3-super-120b-a12b: creator outside the providers the catalogue covers
- nvidia-nemotron-3-ultra-550b-a55b: creator outside the providers the catalogue covers
- nvidia-nemotron-nano-12b-v2-vl: creator outside the providers the catalogue covers
- nvidia-nemotron-nano-12b-v2-vl-reasoning: creator outside the providers the catalogue covers
- nvidia-nemotron-nano-9b-v2: creator outside the providers the catalogue covers
- nvidia-nemotron-nano-9b-v2-reasoning: creator outside the providers the catalogue covers
- o1: released before 2025-07-01
- o1-mini: released before 2025-07-01
- o1-preview: released before 2025-07-01
- o1-pro: released before 2025-07-01
- o3: released before 2025-07-01
- o3 Mini: released before 2025-07-01
- o3 Mini High: released before 2025-07-01
- o3 Pro: released before 2025-07-01
- o4 Mini: released before 2025-07-01
- olmo-2-32b: creator outside the providers the catalogue covers
- olmo-2-7b: creator outside the providers the catalogue covers
- olmo-3-1-32b-instruct: creator outside the providers the catalogue covers
- olmo-3-1-32b-think: creator outside the providers the catalogue covers
- olmo-3-32b-think: creator outside the providers the catalogue covers
- olmo-3-7b-instruct: creator outside the providers the catalogue covers
- olmo-3-7b-think: creator outside the providers the catalogue covers
- openchat-35: creator outside the providers the catalogue covers
- palm-2: released before 2025-07-01
- phi-3-mini: creator outside the providers the catalogue covers
- phi-4-mini: creator outside the providers the catalogue covers
- phi-4-multimodal: creator outside the providers the catalogue covers
- pixtral-large-2411: released before 2025-07-01
- quasar-438b: creator outside the providers the catalogue covers
- qwen-2-5-max: released before 2025-07-01
- qwen-chat-14b: released before 2025-07-01
- qwen-chat-72b: released before 2025-07-01
- qwen-turbo: released before 2025-07-01
- qwen1.5-110b-chat: released before 2025-07-01
- qwen2-5-72b-instruct: released before 2025-07-01
- qwen2-5-coder-32b-instruct: released before 2025-07-01
- qwen2-5-coder-7b-instruct: released before 2025-07-01
- qwen2-72b-instruct: released before 2025-07-01
- qwen2.5-32b-instruct: released before 2025-07-01
- qwen3-0.6b-instruct: released before 2025-07-01
- qwen3-0.6b-instruct-reasoning: released before 2025-07-01
- qwen3-1.7b-instruct: released before 2025-07-01
- qwen3-1.7b-instruct-reasoning: released before 2025-07-01
- qwen3-14b-instruct: released before 2025-07-01
- qwen3-14b-instruct-reasoning: released before 2025-07-01
- qwen3-235b-a22b-instruct: released before 2025-07-01
- qwen3-235b-a22b-instruct-reasoning: released before 2025-07-01
- qwen3-30b-a3b-instruct: released before 2025-07-01
- qwen3-30b-a3b-instruct-reasoning: released before 2025-07-01
- qwen3-32b-instruct: released before 2025-07-01
- qwen3-32b-instruct-reasoning: released before 2025-07-01
- qwen3-4b-instruct: released before 2025-07-01
- qwen3-4b-instruct-reasoning: released before 2025-07-01
- qwen3-8b-instruct: released before 2025-07-01
- qwen3-8b-instruct-reasoning: released before 2025-07-01
- qwq-32b: released before 2025-07-01
- r1-1776: creator outside the providers the catalogue covers
- reka-flash: creator outside the providers the catalogue covers
- ring-1t: creator outside the providers the catalogue covers
- ring-2-6-1t: creator outside the providers the catalogue covers
- ring-flash-2-0: creator outside the providers the catalogue covers
- sarvam-105b: creator outside the providers the catalogue covers
- sarvam-30b: creator outside the providers the catalogue covers
- sarvam-m-reasoning: creator outside the providers the catalogue covers
- seed-oss-36b-instruct: creator outside the providers the catalogue covers
- solar-mini: creator outside the providers the catalogue covers
- solar-mini4: creator outside the providers the catalogue covers
- solar-open-100b-reasoning: creator outside the providers the catalogue covers
- solar-open2-250b: creator outside the providers the catalogue covers
- solar-pro-2: creator outside the providers the catalogue covers
- solar-pro-2-preview: creator outside the providers the catalogue covers
- solar-pro-2-preview-reasoning: creator outside the providers the catalogue covers
- solar-pro-2-reasoning: creator outside the providers the catalogue covers
- sonar: creator outside the providers the catalogue covers
- sonar-pro: creator outside the providers the catalogue covers
- sonar-reasoning: creator outside the providers the catalogue covers
- sonar-reasoning-pro: creator outside the providers the catalogue covers
- step-3-5-flash: creator outside the providers the catalogue covers
- step-3-5-flash-0202: creator outside the providers the catalogue covers
- step-3-7-flash: creator outside the providers the catalogue covers
- step-3-vl-10b: creator outside the providers the catalogue covers
- step-5: creator outside the providers the catalogue covers
- tiny-aya-global: creator outside the providers the catalogue covers
- tri-21b-think-preview: creator outside the providers the catalogue covers
- tri-21b-think-v0-5: creator outside the providers the catalogue covers
- tulu3-405b: creator outside the providers the catalogue covers
Data sourced from Artificial Analysis. Licence: Artificial Analysis commercial data licence.