Benchmarks / Artificial Analysis
Reported by Artificial Analysis
Artificial Analysis
Share of terminal tasks (software, system and data jobs) an agent completes, as run by Artificial Analysis with its own harness and prompts.
- Results dated
- 1 Oct 2026
- Models
- 150
- Unit
- % of tasks
Full results
| # | Model | Artificial Analysis: Terminal-Bench 4.0 % of tasks, higher is better |
|---|---|---|
| 1 | Claude Sonnet 5.5 (max)Anthropic |
63.6%
|
| 2 | Claude Opus 5.5 (max reasoning)Anthropic |
59.6%
|
| 2 | Claude Opus 5.5 (xhigh reasoning)Anthropic |
59.6%
|
| 2 | GPT-6 Astra (xhigh reasoning)OpenAI |
59.6%
|
| 5 | GPT-6 Astra (max)OpenAI |
59.1%
|
| 6 | Claude Sonnet 5.5 (xhigh)Anthropic |
57.1%
|
| 6 | Gemini 4 Argon (high)Google |
57.1%
|
| 8 | Claude Opus 5.5 (high)Anthropic |
56.6%
|
| 9 | GPT-6.1 Sol (max)OpenAI |
56.1%
|
| 10 | Claude Fable 5.1 (xhigh)Anthropic |
55.1%
|
| 11 | GPT-6.1 Sol (xhigh)OpenAI |
54.0%
|
| 11 | GPT-6 Astra (high reasoning)OpenAI |
54.0%
|
| 13 | Claude Opus 5.5 (medium reasoning)Anthropic |
52.5%
|
| 14 | Claude Fable 5.1 (high reasoning)Anthropic |
52.0%
|
| 14 | Claude Fable 5.1 (max)Anthropic |
52.0%
|
| 16 | GPT-6.1 Sol (high)OpenAI |
51.5%
|
| 17 | GPT-6 Astra (medium reasoning)OpenAI |
49.5%
|
| 18 | Claude Opus 5 (max)Anthropic |
49.0%
|
| 19 | GPT-6.1 Sol (medium)OpenAI |
48.0%
|
| 20 | Claude Opus 5 (xhigh)Anthropic |
46.5%
|
| 21 | Claude Opus 5 (high)Anthropic |
46.0%
|
| 22 | Claude Fable 5.1 (medium reasoning)Anthropic |
44.9%
|
| 23 | Claude Sonnet 5.5 (high)Anthropic |
43.9%
|
| 23 | GPT-6 Sol (max)OpenAI |
43.9%
|
| 25 | Claude Fable 5 (max reasoning)Anthropic |
42.4%
|
| 26 | GPT-6 Astra (low reasoning)OpenAI |
41.9%
|
| 26 | GLM 5.3 (max)Z.ai |
41.9%
|
| 28 | Claude Fable 5.1 (low reasoning)Anthropic |
40.4%
|
| 29 | GPT-5.6 Sol (max)OpenAI |
39.9%
|
| 30 | Qwen3.8 Max (0902)Alibaba |
38.9%
|
| 31 | GPT-5.6 Terra (max)OpenAI |
35.4%
|
| 32 | GLM 5.3 (low reasoning)Z.ai |
34.8%
|
| 33 | Claude Opus 5 (medium)Anthropic |
34.3%
|
| 34 | Muse Spark 1.3 (max)Meta |
33.3%
|
| 35 | GLM 5.3 FlashZ.ai |
32.8%
|
| 36 | Claude Opus 5.5 (low reasoning)Anthropic |
31.3%
|
| 37 | GPT-6.1 Sol (low)OpenAI |
30.8%
|
| 38 | GPT-6 Sol (xhigh)OpenAI |
30.3%
|
| 39 | Claude Sonnet 5.5 (medium)Anthropic |
29.8%
|
| 40 | DeepSeek V4.1 Flash (max)DeepSeek |
26.8%
|
| 41 | Claude Opus 5 (low)Anthropic |
26.3%
|
| 41 | GPT-6 Sol (high)OpenAI |
26.3%
|
| 43 | Grok 4.7 (xhigh)xAI |
25.8%
|
| 44 | Qwen3.8 Flash NextAlibaba |
25.3%
|
| 45 | GPT-5.6 Sol (xhigh)OpenAI |
24.7%
|
| 45 | Grok 4.7 (high)xAI |
24.7%
|
| 47 | Claude Opus 4.8 (max reasoning)Anthropic |
21.7%
|
| 48 | Grok 4.6 (high)xAI |
21.2%
|
| 49 | Claude Sonnet 5.5 (low reasoning)Anthropic |
20.7%
|
| 49 | GPT-5.6 Sol (high reasoning)OpenAI |
20.7%
|
| 51 | Gemini 3.8 Flash (high)Google |
19.7%
|
| 51 | Gemini 3.8 Flash (medium reasoning)Google |
19.7%
|
| 53 | Qwen3.8 Max (0803)Alibaba |
18.7%
|
| 53 | GPT-6 Sol (medium)OpenAI |
18.7%
|
| 55 | Grok 4.6 (xhigh)xAI |
17.2%
|
| 56 | Muse Spark 1.3 (xhigh)Meta |
16.7%
|
| 57 | deepseek-v4-pro-preview (max reasoning)DeepSeek |
14.6%
|
| 57 | GPT-5.5 (xhigh reasoning)OpenAI |
14.6%
|
| 57 | GPT-5.6 Sol (medium reasoning)OpenAI |
14.6%
|
| 60 | Claude Sonnet 5 (max reasoning)Anthropic |
14.1%
|
| 60 | DeepSeek V4 Pro 0423 (max)DeepSeek |
14.1%
|
| 62 | Gemini 3.7 Flash (high)Google |
13.6%
|
| 63 | GPT-6 Sol (no reasoning)OpenAI |
13.1%
|
| 63 | Grok 4.6 (medium)xAI |
13.1%
|
| 65 | Kimi K3 (low reasoning)Moonshot AI |
12.6%
|
| 65 | Kimi K3 (max)Moonshot AI |
12.6%
|
| 65 | GPT-5.5 Instant (26 June)OpenAI |
12.6%
|
| 65 | GPT-6 Luna (max)OpenAI |
12.6%
|
| 69 | DeepSeek V4 Flash Vision (experimental, max)DeepSeek |
12.1%
|
| 69 | DeepSeek V4 Flash 0423 (max)DeepSeek |
12.1%
|
| 71 | GPT-5.6 Luna (max)OpenAI |
11.6%
|
| 72 | Qwen3.8 2.4T A95BAlibaba |
11.1%
|
| 73 | Grok 4.5 (high)xAI |
10.6%
|
| 74 | Gemini 3.8 Flash (low reasoning)Google |
10.1%
|
| 74 | GPT-5.6 Terra (xhigh)OpenAI |
10.1%
|
| 76 | GPT-5.5 (high)OpenAI |
9.1%
|
| 76 | GPT-6 Sol (low)OpenAI |
9.1%
|
| 78 | GPT-6 Luna (xhigh)OpenAI |
8.1%
|
| 79 | Claude Sonnet 5 (xhigh reasoning)Anthropic |
7.1%
|
| 79 | Gemini 3.6 Flash (high)Google |
7.1%
|
| 79 | Muse Spark 1.2Meta |
7.1%
|
| 82 | Gemini 3.5 Flash (high)Google |
6.6%
|
| 83 | Muse Spark 1.1 (xhigh)Meta |
6.1%
|
| 84 | Qwen3.8 27B (xhigh)Alibaba |
5.6%
|
| 84 | DeepSeek V4.1 Flash (off)DeepSeek |
5.6%
|
| 86 | Qwen3.8 27B (medium)Alibaba |
5.1%
|
| 86 | Claude Sonnet 5 (high)Anthropic |
5.1%
|
| 86 | GPT-5.5 (medium reasoning)OpenAI |
5.1%
|
| 89 | GPT-6 Luna (high)OpenAI |
4.5%
|
| 90 | Gemini 3.1 Pro PreviewGoogle |
4.0%
|
| 91 | GPT-5.6 Luna (xhigh)OpenAI |
3.5%
|
| 92 | Claude Sonnet 4.6 (max reasoning)Anthropic |
3.0%
|
| 92 | deepseek-v4-flash-preview (high reasoning)DeepSeek |
3.0%
|
| 92 | Grok 4.6 (low)xAI |
3.0%
|
| 95 | Qwen3.8 27B (low)Alibaba |
2.5%
|
| 95 | Claude Sonnet 5 (low reasoning)Anthropic |
2.5%
|
| 95 | deepseek-v4-flash-preview (max reasoning)DeepSeek |
2.5%
|
| 95 | GPT-5.6 Luna (high reasoning)OpenAI |
2.5%
|
| 95 | GPT-6 Luna (medium)OpenAI |
2.5%
|
| 100 | Claude Sonnet 5 (medium reasoning)Anthropic |
2.0%
|
| 100 | GPT-5.4 Mini (xhigh)OpenAI |
2.0%
|
| 100 | GLM 5.1Z.ai |
2.0%
|
| 103 | Qwen3.7 MaxAlibaba |
1.5%
|
| 103 | DeepSeek V4 Pro 0423 (no reasoning)DeepSeek |
1.5%
|
| 103 | GPT-5.6 Terra (high reasoning)OpenAI |
1.5%
|
| 103 | GPT-5.6 Terra (low reasoning)OpenAI |
1.5%
|
| 103 | GPT-6 Luna (no reasoning)OpenAI |
1.5%
|
| 108 | Qwen3.7 PlusAlibaba |
1.0%
|
| 108 | Gemini 3.5 Flash LiteGoogle |
1.0%
|
| 108 | Kimi K2.7 CodeMoonshot AI |
1.0%
|
| 108 | GPT-5.6 Luna (no reasoning)OpenAI |
1.0%
|
| 108 | GPT-5.6 Sol (low reasoning)OpenAI |
1.0%
|
| 108 | GPT-5.6 Terra (medium reasoning)OpenAI |
1.0%
|
| 108 | GLM 5.2 (max)Z.ai |
1.0%
|
| 115 | Qwen3.5-9BAlibaba |
0.5%
|
| 115 | Gemini 3.1 Flash Lite PreviewGoogle |
0.5%
|
| 115 | muse-glimmer (high)Meta |
0.5%
|
| 115 | Kimi K2.6Moonshot AI |
0.5%
|
| 115 | GPT-5.4 Nano (xhigh)OpenAI |
0.5%
|
| 115 | GPT-5.6 Luna (medium reasoning)OpenAI |
0.5%
|
| 115 | GPT-5.6 Terra (no reasoning)OpenAI |
0.5%
|
| 122 | Qwen3 235B A22B Thinking 2507Alibaba |
0.0%
|
| 122 | Qwen3 30B A3B Thinking 2507Alibaba |
0.0%
|
| 122 | Qwen3.5-122B-A10BAlibaba |
0.0%
|
| 122 | Qwen3.5 397B A17BAlibaba |
0.0%
|
| 122 | Qwen3.6 27BAlibaba |
0.0%
|
| 122 | Qwen3.6 35B A3BAlibaba |
0.0%
|
| 122 | Qwen3.8 27B (off)Alibaba |
0.0%
|
| 122 | Qwen3 Coder NextAlibaba |
0.0%
|
| 122 | Claude Haiku 4.5 (thinking reasoning)Anthropic |
0.0%
|
| 122 | Claude Sonnet 4.5 (thinking reasoning)Anthropic |
0.0%
|
| 122 | DeepSeek V3.1 TerminusDeepSeek |
0.0%
|
| 122 | Gemma 4 31BGoogle |
0.0%
|
| 122 | gemma-4-e4b-itGoogle |
0.0%
|
| 122 | Devstral 2 2512Mistral |
0.0%
|
| 122 | devstral-small-2-24b-instruct-2512Mistral |
0.0%
|
| 122 | Ministral 3 14B 2512Mistral |
0.0%
|
| 122 | Ministral 3 3B 2512Mistral |
0.0%
|
| 122 | Ministral 3 8B 2512Mistral |
0.0%
|
| 122 | Mistral Large 3 2512Mistral |
0.0%
|
| 122 | Mistral Medium 3.1Mistral |
0.0%
|
| 122 | Mistral Medium 3.5Mistral |
0.0%
|
| 122 | Mistral Small 4Mistral |
0.0%
|
| 122 | GPT-5.6 Luna (low reasoning)OpenAI |
0.0%
|
| 122 | GPT-5 Mini (high)OpenAI |
0.0%
|
| 122 | GPT-6 Luna (low)OpenAI |
0.0%
|
| 122 | gpt-oss-120b (high)OpenAI |
0.0%
|
| 122 | gpt-oss-20b (high reasoning)OpenAI |
0.0%
|
| 122 | Grok 4.3 (high)xAI |
0.0%
|
| 122 | Grok 4.3 (off)xAI |
0.0%
|
Results as published by Artificial Analysis; we do not re-run them.
What it measures
Share of terminal tasks (software, system and data jobs) an agent completes, as run by Artificial Analysis with its own harness and prompts.
What it does not measure
Not other harnesses or tools; one attempt per task.
Source
Failures
Failures count against a model: a product with no usable output is a failed listing. They are listed here so you can see why.
Not ranked
- Command A: creator outside the providers the catalogue covers
- GPT-4 Turbo: released before 2025-07-01
- GPT-4o (2024-05-13): released before 2025-07-01
- GPT-4o (2024-08-06): released before 2025-07-01
- Hy3: creator outside the providers the catalogue covers
- Hy3 preview: creator outside the providers the catalogue covers
- Inkling: creator outside the providers the catalogue covers
- Inkling Small: creator outside the providers the catalogue covers
- Llama 4 Maverick: released before 2025-07-01
- Llama 4 Scout: released before 2025-07-01
- Mercury 2: creator outside the providers the catalogue covers
- MiniMax M2: creator outside the providers the catalogue covers
- MiniMax M3: creator outside the providers the catalogue covers
- Mistral Large 2407: released before 2025-07-01
- Mistral Medium 3: released before 2025-07-01
- Phi 4: creator outside the providers the catalogue covers
- QwQ-32B-Preview: released before 2025-07-01
- R1: released before 2025-07-01
- Reka Flash 3: creator outside the providers the catalogue covers
- Solar Pro 3: creator outside the providers the catalogue covers
- Solar Pro 4: creator outside the providers the catalogue covers
- Trinity Large Thinking: creator outside the providers the catalogue covers
- a-x-k2: creator outside the providers the catalogue covers
- apertus-70b-instruct: creator outside the providers the catalogue covers
- apertus-8b-instruct: creator outside the providers the catalogue covers
- apodex-1-1: creator outside the providers the catalogue covers
- apriel-v1-5-15b-thinker: creator outside the providers the catalogue covers
- apriel-v1-6-15b-thinker: creator outside the providers the catalogue covers
- arctic-instruct: creator outside the providers the catalogue covers
- celeris-1: creator outside the providers the catalogue covers
- claude-2: released before 2025-07-01
- claude-21: released before 2025-07-01
- claude-3-5-haiku: released before 2025-07-01
- claude-3-7-sonnet: released before 2025-07-01
- claude-3-7-sonnet-thinking: released before 2025-07-01
- claude-3-haiku: released before 2025-07-01
- claude-3-opus: released before 2025-07-01
- claude-3-sonnet: released before 2025-07-01
- claude-35-sonnet: released before 2025-07-01
- claude-35-sonnet-june-24: released before 2025-07-01
- claude-4-opus: released before 2025-07-01
- claude-4-opus-thinking: released before 2025-07-01
- claude-4-sonnet: released before 2025-07-01
- claude-4-sonnet-thinking: released before 2025-07-01
- claude-instant: released before 2025-07-01
- claude-sonnet-4-6-non-reasoning-low-effort: non-standard setting combination
- cogito-v2-1-reasoning: creator outside the providers the catalogue covers
- command-a-plus: creator outside the providers the catalogue covers
- command-r-03-2024: creator outside the providers the catalogue covers
- command-r-plus-04-2024: creator outside the providers the catalogue covers
- dbrx: creator outside the providers the catalogue covers
- deephermes-3-llama-3-1-8b-preview: creator outside the providers the catalogue covers
- deephermes-3-mistral-24b-preview: creator outside the providers the catalogue covers
- deepseek-coder-v2: released before 2025-07-01
- deepseek-coder-v2-lite: released before 2025-07-01
- deepseek-llm-67b-chat: released before 2025-07-01
- deepseek-r1-0120: released before 2025-07-01
- deepseek-r1-distill-llama-70b: released before 2025-07-01
- deepseek-r1-distill-llama-8b: released before 2025-07-01
- deepseek-r1-distill-qwen-1-5b: released before 2025-07-01
- deepseek-r1-distill-qwen-14b: released before 2025-07-01
- deepseek-r1-distill-qwen-32b: released before 2025-07-01
- deepseek-r1-qwen3-8b: released before 2025-07-01
- deepseek-v2: released before 2025-07-01
- deepseek-v2-5: released before 2025-07-01
- deepseek-v2-5-sep-2024: released before 2025-07-01
- deepseek-v3: released before 2025-07-01
- deepseek-v3-0324: released before 2025-07-01
- devstral-small-2505: released before 2025-07-01
- doubao-seed-code: creator outside the providers the catalogue covers
- ernie-4-5-300b-a47b: creator outside the providers the catalogue covers
- ernie-5-0-thinking-preview: creator outside the providers the catalogue covers
- exaone-4-0-1-2b: creator outside the providers the catalogue covers
- exaone-4-0-1-2b-reasoning: creator outside the providers the catalogue covers
- exaone-4-0-32b: creator outside the providers the catalogue covers
- exaone-4-0-32b-reasoning: creator outside the providers the catalogue covers
- exaone-4-5-33b: creator outside the providers the catalogue covers
- falcon-h1r-7b: creator outside the providers the catalogue covers
- g9v3-39a5b: creator outside the providers the catalogue covers
- g9v3-3b: creator outside the providers the catalogue covers
- gemini-1-0-pro: released before 2025-07-01
- gemini-1-0-ultra: released before 2025-07-01
- gemini-1-5-flash: released before 2025-07-01
- gemini-1-5-flash-8b: released before 2025-07-01
- gemini-1-5-flash-may-2024: released before 2025-07-01
- gemini-1-5-pro: released before 2025-07-01
- gemini-1-5-pro-may-2024: released before 2025-07-01
- gemini-2-0-flash: released before 2025-07-01
- gemini-2-0-flash-experimental: released before 2025-07-01
- gemini-2-0-flash-lite-001: released before 2025-07-01
- gemini-2-0-flash-lite-preview: released before 2025-07-01
- gemini-2-0-flash-thinking-exp-0121: released before 2025-07-01
- gemini-2-0-flash-thinking-exp-1219: released before 2025-07-01
- gemini-2-0-pro-experimental-02-05: released before 2025-07-01
- gemini-2-5-flash: released before 2025-07-01
- gemini-2-5-flash-04-2025: released before 2025-07-01
- gemini-2-5-flash-lite: released before 2025-07-01
- gemini-2-5-flash-lite-reasoning: released before 2025-07-01
- gemini-2-5-flash-reasoning: released before 2025-07-01
- gemini-2-5-flash-reasoning-04-2025: released before 2025-07-01
- gemini-2-5-pro: released before 2025-07-01
- gemini-2-5-pro-03-25: released before 2025-07-01
- gemini-2-5-pro-05-06: released before 2025-07-01
- gemma-3-12b: released before 2025-07-01
- gemma-3-1b: released before 2025-07-01
- gemma-3-27b: released before 2025-07-01
- gemma-3-4b: released before 2025-07-01
- gemma-3n-e2b: released before 2025-07-01
- gemma-3n-e4b: released before 2025-07-01
- gemma-3n-e4b-preview-0520: released before 2025-07-01
- gpt-35-turbo: released before 2025-07-01
- gpt-4: released before 2025-07-01
- gpt-4-1: released before 2025-07-01
- gpt-4-1-mini: released before 2025-07-01
- gpt-4-1-nano: released before 2025-07-01
- gpt-4-5: released before 2025-07-01
- gpt-4o: released before 2025-07-01
- gpt-4o-chatgpt: released before 2025-07-01
- gpt-4o-chatgpt-03-25: released before 2025-07-01
- gpt-4o-mini: released before 2025-07-01
- granite-3-3-8b-instruct: creator outside the providers the catalogue covers
- granite-4-0-350m: creator outside the providers the catalogue covers
- granite-4-0-h-350m: creator outside the providers the catalogue covers
- granite-4-0-h-nano-1b: creator outside the providers the catalogue covers
- granite-4-0-h-small: creator outside the providers the catalogue covers
- granite-4-0-micro: creator outside the providers the catalogue covers
- granite-4-0-nano-1b: creator outside the providers the catalogue covers
- granite-4-1-30b: creator outside the providers the catalogue covers
- granite-4-1-3b: creator outside the providers the catalogue covers
- granite-4-1-8b: creator outside the providers the catalogue covers
- granite-4-2-30b: creator outside the providers the catalogue covers
- granite-4-2-3b: creator outside the providers the catalogue covers
- granite-4-2-8b: creator outside the providers the catalogue covers
- grok-1: released before 2025-07-01
- grok-2-1212: released before 2025-07-01
- grok-3: released before 2025-07-01
- grok-3-mini-reasoning: released before 2025-07-01
- grok-3-reasoning: released before 2025-07-01
- grok-beta: released before 2025-07-01
- hermes-3-llama-3-1-70b: creator outside the providers the catalogue covers
- hermes-4-llama-3-1-405b: creator outside the providers the catalogue covers
- hermes-4-llama-3-1-405b-reasoning: creator outside the providers the catalogue covers
- hermes-4-llama-3-1-70b: creator outside the providers the catalogue covers
- hermes-4-llama-3-1-70b-reasoning: creator outside the providers the catalogue covers
- hy3-non-reasoning: creator outside the providers the catalogue covers
- hyperclova-x-seed-think-32b: creator outside the providers the catalogue covers
- hypernova-60b: creator outside the providers the catalogue covers
- intellect-3: creator outside the providers the catalogue covers
- jamba-1-5-large: creator outside the providers the catalogue covers
- jamba-1-5-mini: creator outside the providers the catalogue covers
- jamba-1-6-large: creator outside the providers the catalogue covers
- jamba-1-6-mini: creator outside the providers the catalogue covers
- jamba-1-7-large: creator outside the providers the catalogue covers
- jamba-1-7-mini: creator outside the providers the catalogue covers
- jamba-reasoning-3b: creator outside the providers the catalogue covers
- jt-35b-flash: creator outside the providers the catalogue covers
- jt-4-1-flash-236b-a21b: creator outside the providers the catalogue covers
- jt-mini: creator outside the providers the catalogue covers
- jt236b: creator outside the providers the catalogue covers
- k-exaone: creator outside the providers the catalogue covers
- k-exaone-2-0-0803: creator outside the providers the catalogue covers
- k-exaone-non-reasoning: creator outside the providers the catalogue covers
- k2-horizon-0-9b: creator outside the providers the catalogue covers
- k2-horizon-3-7b: creator outside the providers the catalogue covers
- k2-horizon-375b-a23b: creator outside the providers the catalogue covers
- k2-horizon-7b: creator outside the providers the catalogue covers
- k2-horizon-mova-36b-a4b: creator outside the providers the catalogue covers
- k2-think-v2: creator outside the providers the catalogue covers
- k2-v2: creator outside the providers the catalogue covers
- k2-v2-low: creator outside the providers the catalogue covers
- k2-v2-medium: creator outside the providers the catalogue covers
- kat-coder-pro-v1: creator outside the providers the catalogue covers
- kat-coder-pro-v2: creator outside the providers the catalogue covers
- lfm-40b: creator outside the providers the catalogue covers
- lfm2-1-2b: creator outside the providers the catalogue covers
- lfm2-2-6b: creator outside the providers the catalogue covers
- lfm2-24b-a2b: creator outside the providers the catalogue covers
- lfm2-5-1-2b-instruct: creator outside the providers the catalogue covers
- lfm2-5-1-2b-thinking: creator outside the providers the catalogue covers
- lfm2-5-2-6b: creator outside the providers the catalogue covers
- lfm2-5-8b-a1b: creator outside the providers the catalogue covers
- lfm2-5-vl-1-6b: creator outside the providers the catalogue covers
- lfm2-8b-a1b: creator outside the providers the catalogue covers
- ling-1t: creator outside the providers the catalogue covers
- ling-2-6-1t: creator outside the providers the catalogue covers
- ling-2-6-flash: creator outside the providers the catalogue covers
- ling-3-0-flash: creator outside the providers the catalogue covers
- ling-3-0-flash-fin: creator outside the providers the catalogue covers
- ling-3-0-flash-vl: creator outside the providers the catalogue covers
- ling-3-0-tiny: creator outside the providers the catalogue covers
- ling-flash-2-0: creator outside the providers the catalogue covers
- ling-mini-2-0: creator outside the providers the catalogue covers
- llama-2-chat-13b: released before 2025-07-01
- llama-2-chat-70b: released before 2025-07-01
- llama-2-chat-7b: released before 2025-07-01
- llama-3-1-instruct-405b: released before 2025-07-01
- llama-3-1-instruct-70b: released before 2025-07-01
- llama-3-1-instruct-8b: released before 2025-07-01
- llama-3-1-nemotron-instruct-70b: creator outside the providers the catalogue covers
- llama-3-1-nemotron-nano-4b-reasoning: creator outside the providers the catalogue covers
- llama-3-1-nemotron-ultra-253b-v1-reasoning: creator outside the providers the catalogue covers
- llama-3-2-instruct-11b-vision: released before 2025-07-01
- llama-3-2-instruct-1b: released before 2025-07-01
- llama-3-2-instruct-3b: released before 2025-07-01
- llama-3-2-instruct-90b-vision: released before 2025-07-01
- llama-3-3-instruct-70b: released before 2025-07-01
- llama-3-3-nemotron-super-49b: creator outside the providers the catalogue covers
- llama-3-3-nemotron-super-49b-reasoning: creator outside the providers the catalogue covers
- llama-3-instruct-70b: released before 2025-07-01
- llama-3-instruct-8b: released before 2025-07-01
- llama-65b: released before 2025-07-01
- llama-nemotron-super-49b-v1-5: creator outside the providers the catalogue covers
- llama-nemotron-super-49b-v1-5-reasoning: creator outside the providers the catalogue covers
- longcat-2-0: creator outside the providers the catalogue covers
- longcat-flash-lite: creator outside the providers the catalogue covers
- magistral-medium: released before 2025-07-01
- magistral-small: released before 2025-07-01
- mercury-2-5: creator outside the providers the catalogue covers
- mi-dm-k-2-5-pro-dec28: creator outside the providers the catalogue covers
- midm-250-pro-rsnsft: creator outside the providers the catalogue covers
- mimo-v2-0206: creator outside the providers the catalogue covers
- mimo-v2-5-0424: creator outside the providers the catalogue covers
- mimo-v2-5-pro: creator outside the providers the catalogue covers
- mimo-v2-5-pro-non-reasoning: creator outside the providers the catalogue covers
- mimo-v2-6-flash: creator outside the providers the catalogue covers
- mimo-v2-6-pro: creator outside the providers the catalogue covers
- mimo-v2-flash: creator outside the providers the catalogue covers
- mimo-v2-flash-reasoning: creator outside the providers the catalogue covers
- mimo-v2-omni: creator outside the providers the catalogue covers
- mimo-v2-omni-0327: creator outside the providers the catalogue covers
- mimo-v2-pro: creator outside the providers the catalogue covers
- minicpm-v4-6-1-3b: creator outside the providers the catalogue covers
- minicpm5-1b: creator outside the providers the catalogue covers
- minicpm5-1b-non-reasoning: creator outside the providers the catalogue covers
- minicpm5-2b: creator outside the providers the catalogue covers
- minimax-m1-40k: creator outside the providers the catalogue covers
- minimax-m1-80k: creator outside the providers the catalogue covers
- minimax-m2-1: creator outside the providers the catalogue covers
- minimax-m2-5: creator outside the providers the catalogue covers
- minimax-m2-7: creator outside the providers the catalogue covers
- mistral-7b-instruct: released before 2025-07-01
- mistral-8x22b-instruct: released before 2025-07-01
- mistral-large: released before 2025-07-01
- mistral-large-2: released before 2025-07-01
- mistral-medium: released before 2025-07-01
- mistral-saba: released before 2025-07-01
- mistral-small: released before 2025-07-01
- mistral-small-2402: released before 2025-07-01
- mistral-small-3: released before 2025-07-01
- mistral-small-3-1: released before 2025-07-01
- mistral-small-3-2: released before 2025-07-01
- mixtral-8x7b-instruct: released before 2025-07-01
- molmo-7b-d: creator outside the providers the catalogue covers
- molmo2-8b: creator outside the providers the catalogue covers
- motif-0714: creator outside the providers the catalogue covers
- motif-2-12-7b: creator outside the providers the catalogue covers
- motif-3: creator outside the providers the catalogue covers
- nanbeige4-1-3b: creator outside the providers the catalogue covers
- nemotron-3-5-lightning: creator outside the providers the catalogue covers
- nemotron-3-nano-omni-30b-a3b: creator outside the providers the catalogue covers
- nemotron-cascade-2-30b-a3b: creator outside the providers the catalogue covers
- nex-n2-pro: creator outside the providers the catalogue covers
- north-mini-code: creator outside the providers the catalogue covers
- nova-2-0-lite: creator outside the providers the catalogue covers
- nova-2-0-lite-reasoning: creator outside the providers the catalogue covers
- nova-2-0-lite-reasoning-low: creator outside the providers the catalogue covers
- nova-2-0-lite-reasoning-medium: creator outside the providers the catalogue covers
- nova-2-0-omni: creator outside the providers the catalogue covers
- nova-2-0-omni-reasoning-low: creator outside the providers the catalogue covers
- nova-2-0-omni-reasoning-medium: creator outside the providers the catalogue covers
- nova-2-0-pro: creator outside the providers the catalogue covers
- nova-2-0-pro-reasoning-low: creator outside the providers the catalogue covers
- nova-2-0-pro-reasoning-medium: creator outside the providers the catalogue covers
- nova-lite: creator outside the providers the catalogue covers
- nova-micro: creator outside the providers the catalogue covers
- nova-premier: creator outside the providers the catalogue covers
- nova-pro: creator outside the providers the catalogue covers
- nvidia-nemotron-3-nano-30b-a3b: creator outside the providers the catalogue covers
- nvidia-nemotron-3-nano-30b-a3b-reasoning: creator outside the providers the catalogue covers
- nvidia-nemotron-3-nano-4b: creator outside the providers the catalogue covers
- nvidia-nemotron-3-super-120b-a12b: creator outside the providers the catalogue covers
- nvidia-nemotron-3-ultra-550b-a55b: creator outside the providers the catalogue covers
- nvidia-nemotron-nano-12b-v2-vl: creator outside the providers the catalogue covers
- nvidia-nemotron-nano-12b-v2-vl-reasoning: creator outside the providers the catalogue covers
- nvidia-nemotron-nano-9b-v2: creator outside the providers the catalogue covers
- nvidia-nemotron-nano-9b-v2-reasoning: creator outside the providers the catalogue covers
- o1: released before 2025-07-01
- o1-mini: released before 2025-07-01
- o1-preview: released before 2025-07-01
- o1-pro: released before 2025-07-01
- o3: released before 2025-07-01
- o3 Mini: released before 2025-07-01
- o3 Mini High: released before 2025-07-01
- o3 Pro: released before 2025-07-01
- o4 Mini: released before 2025-07-01
- olmo-2-32b: creator outside the providers the catalogue covers
- olmo-2-7b: creator outside the providers the catalogue covers
- olmo-3-1-32b-instruct: creator outside the providers the catalogue covers
- olmo-3-1-32b-think: creator outside the providers the catalogue covers
- olmo-3-32b-think: creator outside the providers the catalogue covers
- olmo-3-7b-instruct: creator outside the providers the catalogue covers
- olmo-3-7b-think: creator outside the providers the catalogue covers
- openchat-35: creator outside the providers the catalogue covers
- palm-2: released before 2025-07-01
- phi-3-mini: creator outside the providers the catalogue covers
- phi-4-mini: creator outside the providers the catalogue covers
- phi-4-multimodal: creator outside the providers the catalogue covers
- pixtral-large-2411: released before 2025-07-01
- quasar-438b: creator outside the providers the catalogue covers
- qwen-2-5-max: released before 2025-07-01
- qwen-chat-14b: released before 2025-07-01
- qwen-chat-72b: released before 2025-07-01
- qwen-turbo: released before 2025-07-01
- qwen1.5-110b-chat: released before 2025-07-01
- qwen2-5-72b-instruct: released before 2025-07-01
- qwen2-5-coder-32b-instruct: released before 2025-07-01
- qwen2-5-coder-7b-instruct: released before 2025-07-01
- qwen2-72b-instruct: released before 2025-07-01
- qwen2.5-32b-instruct: released before 2025-07-01
- qwen3-0.6b-instruct: released before 2025-07-01
- qwen3-0.6b-instruct-reasoning: released before 2025-07-01
- qwen3-1.7b-instruct: released before 2025-07-01
- qwen3-1.7b-instruct-reasoning: released before 2025-07-01
- qwen3-14b-instruct: released before 2025-07-01
- qwen3-14b-instruct-reasoning: released before 2025-07-01
- qwen3-235b-a22b-instruct: released before 2025-07-01
- qwen3-235b-a22b-instruct-reasoning: released before 2025-07-01
- qwen3-30b-a3b-instruct: released before 2025-07-01
- qwen3-30b-a3b-instruct-reasoning: released before 2025-07-01
- qwen3-32b-instruct: released before 2025-07-01
- qwen3-32b-instruct-reasoning: released before 2025-07-01
- qwen3-4b-instruct: released before 2025-07-01
- qwen3-4b-instruct-reasoning: released before 2025-07-01
- qwen3-8b-instruct: released before 2025-07-01
- qwen3-8b-instruct-reasoning: released before 2025-07-01
- qwq-32b: released before 2025-07-01
- r1-1776: creator outside the providers the catalogue covers
- reka-flash: creator outside the providers the catalogue covers
- ring-1t: creator outside the providers the catalogue covers
- ring-2-6-1t: creator outside the providers the catalogue covers
- ring-flash-2-0: creator outside the providers the catalogue covers
- sarvam-105b: creator outside the providers the catalogue covers
- sarvam-30b: creator outside the providers the catalogue covers
- sarvam-m-reasoning: creator outside the providers the catalogue covers
- seed-oss-36b-instruct: creator outside the providers the catalogue covers
- solar-mini: creator outside the providers the catalogue covers
- solar-mini4: creator outside the providers the catalogue covers
- solar-open-100b-reasoning: creator outside the providers the catalogue covers
- solar-open2-250b: creator outside the providers the catalogue covers
- solar-pro-2: creator outside the providers the catalogue covers
- solar-pro-2-preview: creator outside the providers the catalogue covers
- solar-pro-2-preview-reasoning: creator outside the providers the catalogue covers
- solar-pro-2-reasoning: creator outside the providers the catalogue covers
- sonar: creator outside the providers the catalogue covers
- sonar-pro: creator outside the providers the catalogue covers
- sonar-reasoning: creator outside the providers the catalogue covers
- sonar-reasoning-pro: creator outside the providers the catalogue covers
- step-3-5-flash: creator outside the providers the catalogue covers
- step-3-5-flash-0202: creator outside the providers the catalogue covers
- step-3-7-flash: creator outside the providers the catalogue covers
- step-3-vl-10b: creator outside the providers the catalogue covers
- step-5: creator outside the providers the catalogue covers
- tiny-aya-global: creator outside the providers the catalogue covers
- tri-21b-think-preview: creator outside the providers the catalogue covers
- tri-21b-think-v0-5: creator outside the providers the catalogue covers
- tulu3-405b: creator outside the providers the catalogue covers
Data sourced from Artificial Analysis. Licence: Artificial Analysis commercial data licence.