Benchmarks / Artificial Analysis
Reported by Artificial Analysis
Artificial Analysis
Share of simulated bank customer-service tasks an agent resolves with tools, as run by Artificial Analysis with its own harness and prompts.
- Results dated
- 1 Oct 2026
- Models
- 142
- Unit
- % of tasks
Full results
| # | Model | Artificial Analysis: τ-bench banking % of tasks, higher is better |
|---|---|---|
| 1 | Qwen3.8 Max (0803)Alibaba |
51.3%
|
| 2 | Grok 4.6 (high)xAI |
50.7%
|
| 3 | Muse Spark 1.3 (max)Meta |
50.5%
|
| 4 | GLM 5.3 (max)Z.ai |
50.3%
|
| 5 | Qwen3.8 2.4T A95BAlibaba |
49.1%
|
| 6 | Qwen3.8 27B (xhigh)Alibaba |
48.0%
|
| 7 | Qwen3.8 Max (0902)Alibaba |
47.8%
|
| 8 | Qwen3.8 27B (medium)Alibaba |
47.4%
|
| 9 | Claude Fable 5.1 (max)Anthropic |
47.2%
|
| 9 | Muse Spark 1.3 (xhigh)Meta |
47.2%
|
| 9 | GLM 5.3 FlashZ.ai |
47.2%
|
| 12 | Kimi K3 (max)Moonshot AI |
46.0%
|
| 13 | Claude Fable 5.1 (xhigh)Anthropic |
45.8%
|
| 13 | Gemini 3.8 Flash (medium reasoning)Google |
45.8%
|
| 15 | Qwen3.8 Flash NextAlibaba |
45.4%
|
| 16 | Gemini 3.8 Flash (high)Google |
44.9%
|
| 17 | Claude Opus 5 (high)Anthropic |
44.7%
|
| 18 | GPT-5.6 Sol (max)OpenAI |
44.3%
|
| 18 | Grok 4.6 (medium)xAI |
44.3%
|
| 20 | Claude Opus 5 (xhigh)Anthropic |
43.3%
|
| 20 | Grok 4.6 (xhigh)xAI |
43.3%
|
| 22 | Claude Fable 5.1 (high reasoning)Anthropic |
43.1%
|
| 22 | GPT-6 Astra (xhigh reasoning)OpenAI |
43.1%
|
| 24 | Claude Opus 5 (max)Anthropic |
42.1%
|
| 24 | Grok 4.5 (high)xAI |
42.1%
|
| 26 | Kimi K3 (low reasoning)Moonshot AI |
41.6%
|
| 27 | GPT-6 Astra (max)OpenAI |
41.4%
|
| 28 | Claude Fable 5.1 (medium reasoning)Anthropic |
41.0%
|
| 28 | DeepSeek V4 Flash Vision (experimental, max)DeepSeek |
41.0%
|
| 30 | GPT-5.6 Terra (max)OpenAI |
40.2%
|
| 31 | GPT-6 Astra (high reasoning)OpenAI |
40.0%
|
| 32 | DeepSeek V4 Pro 0423 (max)DeepSeek |
39.6%
|
| 32 | GPT-5.4 (xhigh reasoning)OpenAI |
39.6%
|
| 34 | DeepSeek V4 Flash 0423 (max)DeepSeek |
39.4%
|
| 35 | Claude Fable 5.1 (low reasoning)Anthropic |
39.0%
|
| 35 | GPT-5.5 (xhigh reasoning)OpenAI |
39.0%
|
| 37 | Claude Opus 5 (medium)Anthropic |
38.6%
|
| 38 | Claude Fable 5 (max reasoning)Anthropic |
38.1%
|
| 38 | GPT-5.6 Sol (xhigh)OpenAI |
38.1%
|
| 38 | Grok 4.6 (low)xAI |
38.1%
|
| 41 | Claude Sonnet 5 (max reasoning)Anthropic |
37.3%
|
| 42 | GPT-5.5 (high)OpenAI |
36.7%
|
| 42 | GPT-5.6 Sol (high reasoning)OpenAI |
36.7%
|
| 44 | GPT-5.6 Sol (medium reasoning)OpenAI |
36.5%
|
| 45 | Gemini 3.7 Flash (medium reasoning)Google |
35.5%
|
| 45 | GPT-6 Astra (medium reasoning)OpenAI |
35.5%
|
| 47 | Muse Spark 1.2Meta |
34.8%
|
| 48 | Claude Opus 4.7 (max reasoning)Anthropic |
34.6%
|
| 48 | GLM 5.2 (max)Z.ai |
34.6%
|
| 50 | Claude Sonnet 4.6 (max reasoning)Anthropic |
34.4%
|
| 51 | Claude Opus 4.8 (max reasoning)Anthropic |
34.2%
|
| 52 | Gemini 3.8 Flash (low reasoning)Google |
33.2%
|
| 53 | Gemini 3.7 Flash (high)Google |
32.8%
|
| 54 | Qwen3.8 27B (low)Alibaba |
32.2%
|
| 54 | Gemini 3.5 Flash (high)Google |
32.2%
|
| 56 | GPT-6 Astra (low reasoning)OpenAI |
32.0%
|
| 57 | Muse Spark 1.1 (xhigh)Meta |
31.8%
|
| 58 | GPT-5.6 Luna (max)OpenAI |
31.1%
|
| 59 | deepseek-v4-flash-preview (max reasoning)DeepSeek |
30.9%
|
| 60 | Claude Opus 5 (low)Anthropic |
30.3%
|
| 61 | deepseek-v4-pro-preview (max reasoning)DeepSeek |
30.1%
|
| 62 | Gemini 3.6 Flash (high)Google |
29.9%
|
| 62 | GPT-5.5 (medium reasoning)OpenAI |
29.9%
|
| 64 | GPT-5.6 Terra (xhigh)OpenAI |
29.7%
|
| 65 | Gemini 3.7 Flash (low reasoning)Google |
29.5%
|
| 66 | GPT-5.6 Sol (low reasoning)OpenAI |
29.1%
|
| 67 | GPT-5.6 Luna (xhigh)OpenAI |
28.7%
|
| 67 | GPT-5.6 Terra (high reasoning)OpenAI |
28.7%
|
| 69 | GPT-5.4 Nano (xhigh)OpenAI |
27.4%
|
| 70 | deepseek-v4-flash-preview (high reasoning)DeepSeek |
26.2%
|
| 70 | deepseek-v4-pro-preview (high reasoning)DeepSeek |
26.2%
|
| 72 | GPT-5.4 Mini (xhigh)OpenAI |
25.6%
|
| 72 | GPT-5.6 Terra (medium reasoning)OpenAI |
25.6%
|
| 74 | GPT-5.6 Luna (high reasoning)OpenAI |
25.2%
|
| 75 | GPT-5.5 (low reasoning)OpenAI |
24.9%
|
| 76 | Claude Sonnet 4.5 (thinking reasoning)Anthropic |
24.5%
|
| 77 | muse-glimmer (high)Meta |
23.5%
|
| 78 | Kimi K2.6Moonshot AI |
23.3%
|
| 79 | GPT-5 (high)OpenAI |
22.1%
|
| 80 | Gemini 3.1 Pro PreviewGoogle |
21.4%
|
| 81 | DeepSeek V3.1 TerminusDeepSeek |
21.0%
|
| 82 | Qwen3.6 PlusAlibaba |
20.8%
|
| 82 | gemini-3-flash (thinking reasoning)Google |
20.8%
|
| 84 | Kimi K2.7 CodeMoonshot AI |
20.2%
|
| 85 | Qwen3.8 27B (off)Alibaba |
20.0%
|
| 86 | GPT-5.6 Sol (no reasoning)OpenAI |
19.6%
|
| 87 | GPT-5.6 Terra (low reasoning)OpenAI |
18.8%
|
| 88 | GPT-5.6 Luna (medium reasoning)OpenAI |
17.7%
|
| 89 | Qwen3.7 PlusAlibaba |
17.5%
|
| 89 | Gemini 3.5 Flash LiteGoogle |
17.5%
|
| 91 | Qwen3.6 27BAlibaba |
16.7%
|
| 91 | GLM 5.2 (no reasoning)Z.ai |
16.7%
|
| 93 | GPT-5.1 (high)OpenAI |
15.9%
|
| 94 | Claude Sonnet 5 (off)Anthropic |
15.7%
|
| 94 | GPT-5.6 Terra (no reasoning)OpenAI |
15.7%
|
| 96 | GPT-5 Mini (high)OpenAI |
15.5%
|
| 97 | Qwen3.5-122B-A10BAlibaba |
15.3%
|
| 98 | Mistral Medium 3.5Mistral |
15.1%
|
| 99 | Gemma 4 31BGoogle |
14.8%
|
| 99 | GPT-5.5 (no reasoning)OpenAI |
14.8%
|
| 101 | Kimi K2.5Moonshot AI |
14.2%
|
| 102 | GLM 5.1Z.ai |
13.6%
|
| 103 | Qwen3.5 397B A17BAlibaba |
13.4%
|
| 103 | Grok Build 0.1xAI |
13.4%
|
| 103 | GLM 4.6 (thinking reasoning)Z.ai |
13.4%
|
| 106 | GPT-5.6 Luna (low reasoning)OpenAI |
12.8%
|
| 106 | gpt-oss-120b (high)OpenAI |
12.8%
|
| 108 | Grok 4.3 (high)xAI |
12.4%
|
| 109 | GLM 4.7Z.ai |
12.2%
|
| 110 | Gemma 4 26B A4BGoogle |
12.0%
|
| 111 | Qwen3.7 MaxAlibaba |
11.8%
|
| 111 | GPT-5.5 Instant (26 June)OpenAI |
11.8%
|
| 113 | GPT-5.2 (no reasoning)OpenAI |
11.1%
|
| 114 | devstral-small-2-24b-instruct-2512Mistral |
10.7%
|
| 115 | Devstral 2 2512Mistral |
10.5%
|
| 116 | Qwen3.5-122B-A10B (no reasoning)Alibaba |
10.3%
|
| 117 | Gemini 3.1 Flash Lite PreviewGoogle |
9.7%
|
| 117 | GPT-5.6 Luna (no reasoning)OpenAI |
9.7%
|
| 119 | Qwen3.6 27B (no reasoning)Alibaba |
9.3%
|
| 119 | Qwen3.6 35B A3BAlibaba |
9.3%
|
| 119 | Claude Haiku 4.5 (thinking reasoning)Anthropic |
9.3%
|
| 122 | Gemma 4 31B (off)Google |
8.9%
|
| 123 | Mistral Medium 3.1Mistral |
8.2%
|
| 124 | Grok 4.3 (off)xAI |
8.0%
|
| 125 | Qwen3 235B A22B Thinking 2507Alibaba |
7.8%
|
| 126 | Qwen3.5-9BAlibaba |
7.0%
|
| 126 | gpt-oss-20b (high reasoning)OpenAI |
7.0%
|
| 128 | qwen3.5-4b (thinking reasoning)Alibaba |
6.8%
|
| 129 | Ministral 3 14B 2512Mistral |
6.6%
|
| 130 | Qwen3 Next 80B A3B ThinkingAlibaba |
6.2%
|
| 131 | Mistral Large 3 2512Mistral |
5.8%
|
| 132 | Magistral Medium 1.2Mistral |
5.6%
|
| 133 | Qwen3 30B A3B Thinking 2507Alibaba |
5.4%
|
| 133 | Qwen3.6 35B A3B (no reasoning)Alibaba |
5.4%
|
| 133 | Qwen3 Coder NextAlibaba |
5.4%
|
| 136 | Qwen3.5-35B-A3B (no reasoning)Alibaba |
4.9%
|
| 136 | Mistral Small 4Mistral |
4.9%
|
| 138 | Ministral 3 3B 2512Mistral |
4.7%
|
| 139 | magistral-small-2509Mistral |
4.5%
|
| 140 | qwen3.5-4b (no reasoning)Alibaba |
4.3%
|
| 141 | Ministral 3 8B 2512Mistral |
3.7%
|
| 142 | gpt-oss-120b (low)OpenAI |
2.9%
|
Results as published by Artificial Analysis; we do not re-run them.
What it measures
Share of simulated bank customer-service tasks an agent resolves with tools, as run by Artificial Analysis with its own harness and prompts.
What it does not measure
Not your policies or systems; a simulated customer.
Source
Failures
Failures count against a model: a product with no usable output is a failed listing. They are listed here so you can see why.
Not ranked
- Command A: creator outside the providers the catalogue covers
- GPT-4 Turbo: released before 2025-07-01
- GPT-4o (2024-05-13): released before 2025-07-01
- GPT-4o (2024-08-06): released before 2025-07-01
- Hy3: creator outside the providers the catalogue covers
- Hy3 preview: creator outside the providers the catalogue covers
- Inkling: creator outside the providers the catalogue covers
- Inkling Small: creator outside the providers the catalogue covers
- Llama 4 Maverick: released before 2025-07-01
- Llama 4 Scout: released before 2025-07-01
- Mercury 2: creator outside the providers the catalogue covers
- MiniMax M2: creator outside the providers the catalogue covers
- MiniMax M3: creator outside the providers the catalogue covers
- Mistral Large 2407: released before 2025-07-01
- Mistral Medium 3: released before 2025-07-01
- Phi 4: creator outside the providers the catalogue covers
- QwQ-32B-Preview: released before 2025-07-01
- R1: released before 2025-07-01
- Reka Flash 3: creator outside the providers the catalogue covers
- Solar Pro 3: creator outside the providers the catalogue covers
- Solar Pro 4: creator outside the providers the catalogue covers
- Trinity Large Thinking: creator outside the providers the catalogue covers
- a-x-k2: creator outside the providers the catalogue covers
- apertus-70b-instruct: creator outside the providers the catalogue covers
- apertus-8b-instruct: creator outside the providers the catalogue covers
- apodex-1-1: creator outside the providers the catalogue covers
- apriel-v1-5-15b-thinker: creator outside the providers the catalogue covers
- apriel-v1-6-15b-thinker: creator outside the providers the catalogue covers
- arctic-instruct: creator outside the providers the catalogue covers
- celeris-1: creator outside the providers the catalogue covers
- claude-2: released before 2025-07-01
- claude-21: released before 2025-07-01
- claude-3-5-haiku: released before 2025-07-01
- claude-3-7-sonnet: released before 2025-07-01
- claude-3-7-sonnet-thinking: released before 2025-07-01
- claude-3-haiku: released before 2025-07-01
- claude-3-opus: released before 2025-07-01
- claude-3-sonnet: released before 2025-07-01
- claude-35-sonnet: released before 2025-07-01
- claude-35-sonnet-june-24: released before 2025-07-01
- claude-4-opus: released before 2025-07-01
- claude-4-opus-thinking: released before 2025-07-01
- claude-4-sonnet: released before 2025-07-01
- claude-4-sonnet-thinking: released before 2025-07-01
- claude-instant: released before 2025-07-01
- claude-sonnet-4-6-non-reasoning-low-effort: non-standard setting combination
- cogito-v2-1-reasoning: creator outside the providers the catalogue covers
- command-a-plus: creator outside the providers the catalogue covers
- command-r-03-2024: creator outside the providers the catalogue covers
- command-r-plus-04-2024: creator outside the providers the catalogue covers
- dbrx: creator outside the providers the catalogue covers
- deephermes-3-llama-3-1-8b-preview: creator outside the providers the catalogue covers
- deephermes-3-mistral-24b-preview: creator outside the providers the catalogue covers
- deepseek-coder-v2: released before 2025-07-01
- deepseek-coder-v2-lite: released before 2025-07-01
- deepseek-llm-67b-chat: released before 2025-07-01
- deepseek-r1-0120: released before 2025-07-01
- deepseek-r1-distill-llama-70b: released before 2025-07-01
- deepseek-r1-distill-llama-8b: released before 2025-07-01
- deepseek-r1-distill-qwen-1-5b: released before 2025-07-01
- deepseek-r1-distill-qwen-14b: released before 2025-07-01
- deepseek-r1-distill-qwen-32b: released before 2025-07-01
- deepseek-r1-qwen3-8b: released before 2025-07-01
- deepseek-v2: released before 2025-07-01
- deepseek-v2-5: released before 2025-07-01
- deepseek-v2-5-sep-2024: released before 2025-07-01
- deepseek-v3: released before 2025-07-01
- deepseek-v3-0324: released before 2025-07-01
- devstral-small-2505: released before 2025-07-01
- doubao-seed-code: creator outside the providers the catalogue covers
- ernie-4-5-300b-a47b: creator outside the providers the catalogue covers
- ernie-5-0-thinking-preview: creator outside the providers the catalogue covers
- exaone-4-0-1-2b: creator outside the providers the catalogue covers
- exaone-4-0-1-2b-reasoning: creator outside the providers the catalogue covers
- exaone-4-0-32b: creator outside the providers the catalogue covers
- exaone-4-0-32b-reasoning: creator outside the providers the catalogue covers
- exaone-4-5-33b: creator outside the providers the catalogue covers
- falcon-h1r-7b: creator outside the providers the catalogue covers
- g9v3-39a5b: creator outside the providers the catalogue covers
- g9v3-3b: creator outside the providers the catalogue covers
- gemini-1-0-pro: released before 2025-07-01
- gemini-1-0-ultra: released before 2025-07-01
- gemini-1-5-flash: released before 2025-07-01
- gemini-1-5-flash-8b: released before 2025-07-01
- gemini-1-5-flash-may-2024: released before 2025-07-01
- gemini-1-5-pro: released before 2025-07-01
- gemini-1-5-pro-may-2024: released before 2025-07-01
- gemini-2-0-flash: released before 2025-07-01
- gemini-2-0-flash-experimental: released before 2025-07-01
- gemini-2-0-flash-lite-001: released before 2025-07-01
- gemini-2-0-flash-lite-preview: released before 2025-07-01
- gemini-2-0-flash-thinking-exp-0121: released before 2025-07-01
- gemini-2-0-flash-thinking-exp-1219: released before 2025-07-01
- gemini-2-0-pro-experimental-02-05: released before 2025-07-01
- gemini-2-5-flash: released before 2025-07-01
- gemini-2-5-flash-04-2025: released before 2025-07-01
- gemini-2-5-flash-lite: released before 2025-07-01
- gemini-2-5-flash-lite-reasoning: released before 2025-07-01
- gemini-2-5-flash-reasoning: released before 2025-07-01
- gemini-2-5-flash-reasoning-04-2025: released before 2025-07-01
- gemini-2-5-pro: released before 2025-07-01
- gemini-2-5-pro-03-25: released before 2025-07-01
- gemini-2-5-pro-05-06: released before 2025-07-01
- gemma-3-12b: released before 2025-07-01
- gemma-3-1b: released before 2025-07-01
- gemma-3-27b: released before 2025-07-01
- gemma-3-4b: released before 2025-07-01
- gemma-3n-e2b: released before 2025-07-01
- gemma-3n-e4b: released before 2025-07-01
- gemma-3n-e4b-preview-0520: released before 2025-07-01
- gpt-35-turbo: released before 2025-07-01
- gpt-4: released before 2025-07-01
- gpt-4-1: released before 2025-07-01
- gpt-4-1-mini: released before 2025-07-01
- gpt-4-1-nano: released before 2025-07-01
- gpt-4-5: released before 2025-07-01
- gpt-4o: released before 2025-07-01
- gpt-4o-chatgpt: released before 2025-07-01
- gpt-4o-chatgpt-03-25: released before 2025-07-01
- gpt-4o-mini: released before 2025-07-01
- granite-3-3-8b-instruct: creator outside the providers the catalogue covers
- granite-4-0-350m: creator outside the providers the catalogue covers
- granite-4-0-h-350m: creator outside the providers the catalogue covers
- granite-4-0-h-nano-1b: creator outside the providers the catalogue covers
- granite-4-0-h-small: creator outside the providers the catalogue covers
- granite-4-0-micro: creator outside the providers the catalogue covers
- granite-4-0-nano-1b: creator outside the providers the catalogue covers
- granite-4-1-30b: creator outside the providers the catalogue covers
- granite-4-1-3b: creator outside the providers the catalogue covers
- granite-4-1-8b: creator outside the providers the catalogue covers
- granite-4-2-30b: creator outside the providers the catalogue covers
- granite-4-2-3b: creator outside the providers the catalogue covers
- granite-4-2-8b: creator outside the providers the catalogue covers
- grok-1: released before 2025-07-01
- grok-2-1212: released before 2025-07-01
- grok-3: released before 2025-07-01
- grok-3-mini-reasoning: released before 2025-07-01
- grok-3-reasoning: released before 2025-07-01
- grok-beta: released before 2025-07-01
- hermes-3-llama-3-1-70b: creator outside the providers the catalogue covers
- hermes-4-llama-3-1-405b: creator outside the providers the catalogue covers
- hermes-4-llama-3-1-405b-reasoning: creator outside the providers the catalogue covers
- hermes-4-llama-3-1-70b: creator outside the providers the catalogue covers
- hermes-4-llama-3-1-70b-reasoning: creator outside the providers the catalogue covers
- hy3-non-reasoning: creator outside the providers the catalogue covers
- hyperclova-x-seed-think-32b: creator outside the providers the catalogue covers
- hypernova-60b: creator outside the providers the catalogue covers
- intellect-3: creator outside the providers the catalogue covers
- jamba-1-5-large: creator outside the providers the catalogue covers
- jamba-1-5-mini: creator outside the providers the catalogue covers
- jamba-1-6-large: creator outside the providers the catalogue covers
- jamba-1-6-mini: creator outside the providers the catalogue covers
- jamba-1-7-large: creator outside the providers the catalogue covers
- jamba-1-7-mini: creator outside the providers the catalogue covers
- jamba-reasoning-3b: creator outside the providers the catalogue covers
- jt-35b-flash: creator outside the providers the catalogue covers
- jt-4-1-flash-236b-a21b: creator outside the providers the catalogue covers
- jt-mini: creator outside the providers the catalogue covers
- jt236b: creator outside the providers the catalogue covers
- k-exaone: creator outside the providers the catalogue covers
- k-exaone-2-0-0803: creator outside the providers the catalogue covers
- k-exaone-non-reasoning: creator outside the providers the catalogue covers
- k2-horizon-0-9b: creator outside the providers the catalogue covers
- k2-horizon-3-7b: creator outside the providers the catalogue covers
- k2-horizon-375b-a23b: creator outside the providers the catalogue covers
- k2-horizon-7b: creator outside the providers the catalogue covers
- k2-horizon-mova-36b-a4b: creator outside the providers the catalogue covers
- k2-think-v2: creator outside the providers the catalogue covers
- k2-v2: creator outside the providers the catalogue covers
- k2-v2-low: creator outside the providers the catalogue covers
- k2-v2-medium: creator outside the providers the catalogue covers
- kat-coder-pro-v1: creator outside the providers the catalogue covers
- kat-coder-pro-v2: creator outside the providers the catalogue covers
- lfm-40b: creator outside the providers the catalogue covers
- lfm2-1-2b: creator outside the providers the catalogue covers
- lfm2-2-6b: creator outside the providers the catalogue covers
- lfm2-24b-a2b: creator outside the providers the catalogue covers
- lfm2-5-1-2b-instruct: creator outside the providers the catalogue covers
- lfm2-5-1-2b-thinking: creator outside the providers the catalogue covers
- lfm2-5-2-6b: creator outside the providers the catalogue covers
- lfm2-5-8b-a1b: creator outside the providers the catalogue covers
- lfm2-5-vl-1-6b: creator outside the providers the catalogue covers
- lfm2-8b-a1b: creator outside the providers the catalogue covers
- ling-1t: creator outside the providers the catalogue covers
- ling-2-6-1t: creator outside the providers the catalogue covers
- ling-2-6-flash: creator outside the providers the catalogue covers
- ling-3-0-flash: creator outside the providers the catalogue covers
- ling-3-0-flash-fin: creator outside the providers the catalogue covers
- ling-3-0-flash-vl: creator outside the providers the catalogue covers
- ling-3-0-tiny: creator outside the providers the catalogue covers
- ling-flash-2-0: creator outside the providers the catalogue covers
- ling-mini-2-0: creator outside the providers the catalogue covers
- llama-2-chat-13b: released before 2025-07-01
- llama-2-chat-70b: released before 2025-07-01
- llama-2-chat-7b: released before 2025-07-01
- llama-3-1-instruct-405b: released before 2025-07-01
- llama-3-1-instruct-70b: released before 2025-07-01
- llama-3-1-instruct-8b: released before 2025-07-01
- llama-3-1-nemotron-instruct-70b: creator outside the providers the catalogue covers
- llama-3-1-nemotron-nano-4b-reasoning: creator outside the providers the catalogue covers
- llama-3-1-nemotron-ultra-253b-v1-reasoning: creator outside the providers the catalogue covers
- llama-3-2-instruct-11b-vision: released before 2025-07-01
- llama-3-2-instruct-1b: released before 2025-07-01
- llama-3-2-instruct-3b: released before 2025-07-01
- llama-3-2-instruct-90b-vision: released before 2025-07-01
- llama-3-3-instruct-70b: released before 2025-07-01
- llama-3-3-nemotron-super-49b: creator outside the providers the catalogue covers
- llama-3-3-nemotron-super-49b-reasoning: creator outside the providers the catalogue covers
- llama-3-instruct-70b: released before 2025-07-01
- llama-3-instruct-8b: released before 2025-07-01
- llama-65b: released before 2025-07-01
- llama-nemotron-super-49b-v1-5: creator outside the providers the catalogue covers
- llama-nemotron-super-49b-v1-5-reasoning: creator outside the providers the catalogue covers
- longcat-2-0: creator outside the providers the catalogue covers
- longcat-flash-lite: creator outside the providers the catalogue covers
- magistral-medium: released before 2025-07-01
- magistral-small: released before 2025-07-01
- mercury-2-5: creator outside the providers the catalogue covers
- mi-dm-k-2-5-pro-dec28: creator outside the providers the catalogue covers
- midm-250-pro-rsnsft: creator outside the providers the catalogue covers
- mimo-v2-0206: creator outside the providers the catalogue covers
- mimo-v2-5-0424: creator outside the providers the catalogue covers
- mimo-v2-5-pro: creator outside the providers the catalogue covers
- mimo-v2-5-pro-non-reasoning: creator outside the providers the catalogue covers
- mimo-v2-6-flash: creator outside the providers the catalogue covers
- mimo-v2-6-pro: creator outside the providers the catalogue covers
- mimo-v2-flash: creator outside the providers the catalogue covers
- mimo-v2-flash-reasoning: creator outside the providers the catalogue covers
- mimo-v2-omni: creator outside the providers the catalogue covers
- mimo-v2-omni-0327: creator outside the providers the catalogue covers
- mimo-v2-pro: creator outside the providers the catalogue covers
- minicpm-v4-6-1-3b: creator outside the providers the catalogue covers
- minicpm5-1b: creator outside the providers the catalogue covers
- minicpm5-1b-non-reasoning: creator outside the providers the catalogue covers
- minicpm5-2b: creator outside the providers the catalogue covers
- minimax-m1-40k: creator outside the providers the catalogue covers
- minimax-m1-80k: creator outside the providers the catalogue covers
- minimax-m2-1: creator outside the providers the catalogue covers
- minimax-m2-5: creator outside the providers the catalogue covers
- minimax-m2-7: creator outside the providers the catalogue covers
- mistral-7b-instruct: released before 2025-07-01
- mistral-8x22b-instruct: released before 2025-07-01
- mistral-large: released before 2025-07-01
- mistral-large-2: released before 2025-07-01
- mistral-medium: released before 2025-07-01
- mistral-saba: released before 2025-07-01
- mistral-small: released before 2025-07-01
- mistral-small-2402: released before 2025-07-01
- mistral-small-3: released before 2025-07-01
- mistral-small-3-1: released before 2025-07-01
- mistral-small-3-2: released before 2025-07-01
- mixtral-8x7b-instruct: released before 2025-07-01
- molmo-7b-d: creator outside the providers the catalogue covers
- molmo2-8b: creator outside the providers the catalogue covers
- motif-0714: creator outside the providers the catalogue covers
- motif-2-12-7b: creator outside the providers the catalogue covers
- motif-3: creator outside the providers the catalogue covers
- nanbeige4-1-3b: creator outside the providers the catalogue covers
- nemotron-3-5-lightning: creator outside the providers the catalogue covers
- nemotron-3-nano-omni-30b-a3b: creator outside the providers the catalogue covers
- nemotron-cascade-2-30b-a3b: creator outside the providers the catalogue covers
- nex-n2-pro: creator outside the providers the catalogue covers
- north-mini-code: creator outside the providers the catalogue covers
- nova-2-0-lite: creator outside the providers the catalogue covers
- nova-2-0-lite-reasoning: creator outside the providers the catalogue covers
- nova-2-0-lite-reasoning-low: creator outside the providers the catalogue covers
- nova-2-0-lite-reasoning-medium: creator outside the providers the catalogue covers
- nova-2-0-omni: creator outside the providers the catalogue covers
- nova-2-0-omni-reasoning-low: creator outside the providers the catalogue covers
- nova-2-0-omni-reasoning-medium: creator outside the providers the catalogue covers
- nova-2-0-pro: creator outside the providers the catalogue covers
- nova-2-0-pro-reasoning-low: creator outside the providers the catalogue covers
- nova-2-0-pro-reasoning-medium: creator outside the providers the catalogue covers
- nova-lite: creator outside the providers the catalogue covers
- nova-micro: creator outside the providers the catalogue covers
- nova-premier: creator outside the providers the catalogue covers
- nova-pro: creator outside the providers the catalogue covers
- nvidia-nemotron-3-nano-30b-a3b: creator outside the providers the catalogue covers
- nvidia-nemotron-3-nano-30b-a3b-reasoning: creator outside the providers the catalogue covers
- nvidia-nemotron-3-nano-4b: creator outside the providers the catalogue covers
- nvidia-nemotron-3-super-120b-a12b: creator outside the providers the catalogue covers
- nvidia-nemotron-3-ultra-550b-a55b: creator outside the providers the catalogue covers
- nvidia-nemotron-nano-12b-v2-vl: creator outside the providers the catalogue covers
- nvidia-nemotron-nano-12b-v2-vl-reasoning: creator outside the providers the catalogue covers
- nvidia-nemotron-nano-9b-v2: creator outside the providers the catalogue covers
- nvidia-nemotron-nano-9b-v2-reasoning: creator outside the providers the catalogue covers
- o1: released before 2025-07-01
- o1-mini: released before 2025-07-01
- o1-preview: released before 2025-07-01
- o1-pro: released before 2025-07-01
- o3: released before 2025-07-01
- o3 Mini: released before 2025-07-01
- o3 Mini High: released before 2025-07-01
- o3 Pro: released before 2025-07-01
- o4 Mini: released before 2025-07-01
- olmo-2-32b: creator outside the providers the catalogue covers
- olmo-2-7b: creator outside the providers the catalogue covers
- olmo-3-1-32b-instruct: creator outside the providers the catalogue covers
- olmo-3-1-32b-think: creator outside the providers the catalogue covers
- olmo-3-32b-think: creator outside the providers the catalogue covers
- olmo-3-7b-instruct: creator outside the providers the catalogue covers
- olmo-3-7b-think: creator outside the providers the catalogue covers
- openchat-35: creator outside the providers the catalogue covers
- palm-2: released before 2025-07-01
- phi-3-mini: creator outside the providers the catalogue covers
- phi-4-mini: creator outside the providers the catalogue covers
- phi-4-multimodal: creator outside the providers the catalogue covers
- pixtral-large-2411: released before 2025-07-01
- quasar-438b: creator outside the providers the catalogue covers
- qwen-2-5-max: released before 2025-07-01
- qwen-chat-14b: released before 2025-07-01
- qwen-chat-72b: released before 2025-07-01
- qwen-turbo: released before 2025-07-01
- qwen1.5-110b-chat: released before 2025-07-01
- qwen2-5-72b-instruct: released before 2025-07-01
- qwen2-5-coder-32b-instruct: released before 2025-07-01
- qwen2-5-coder-7b-instruct: released before 2025-07-01
- qwen2-72b-instruct: released before 2025-07-01
- qwen2.5-32b-instruct: released before 2025-07-01
- qwen3-0.6b-instruct: released before 2025-07-01
- qwen3-0.6b-instruct-reasoning: released before 2025-07-01
- qwen3-1.7b-instruct: released before 2025-07-01
- qwen3-1.7b-instruct-reasoning: released before 2025-07-01
- qwen3-14b-instruct: released before 2025-07-01
- qwen3-14b-instruct-reasoning: released before 2025-07-01
- qwen3-235b-a22b-instruct: released before 2025-07-01
- qwen3-235b-a22b-instruct-reasoning: released before 2025-07-01
- qwen3-30b-a3b-instruct: released before 2025-07-01
- qwen3-30b-a3b-instruct-reasoning: released before 2025-07-01
- qwen3-32b-instruct: released before 2025-07-01
- qwen3-32b-instruct-reasoning: released before 2025-07-01
- qwen3-4b-instruct: released before 2025-07-01
- qwen3-4b-instruct-reasoning: released before 2025-07-01
- qwen3-8b-instruct: released before 2025-07-01
- qwen3-8b-instruct-reasoning: released before 2025-07-01
- qwq-32b: released before 2025-07-01
- r1-1776: creator outside the providers the catalogue covers
- reka-flash: creator outside the providers the catalogue covers
- ring-1t: creator outside the providers the catalogue covers
- ring-2-6-1t: creator outside the providers the catalogue covers
- ring-flash-2-0: creator outside the providers the catalogue covers
- sarvam-105b: creator outside the providers the catalogue covers
- sarvam-30b: creator outside the providers the catalogue covers
- sarvam-m-reasoning: creator outside the providers the catalogue covers
- seed-oss-36b-instruct: creator outside the providers the catalogue covers
- solar-mini: creator outside the providers the catalogue covers
- solar-mini4: creator outside the providers the catalogue covers
- solar-open-100b-reasoning: creator outside the providers the catalogue covers
- solar-open2-250b: creator outside the providers the catalogue covers
- solar-pro-2: creator outside the providers the catalogue covers
- solar-pro-2-preview: creator outside the providers the catalogue covers
- solar-pro-2-preview-reasoning: creator outside the providers the catalogue covers
- solar-pro-2-reasoning: creator outside the providers the catalogue covers
- sonar: creator outside the providers the catalogue covers
- sonar-pro: creator outside the providers the catalogue covers
- sonar-reasoning: creator outside the providers the catalogue covers
- sonar-reasoning-pro: creator outside the providers the catalogue covers
- step-3-5-flash: creator outside the providers the catalogue covers
- step-3-5-flash-0202: creator outside the providers the catalogue covers
- step-3-7-flash: creator outside the providers the catalogue covers
- step-3-vl-10b: creator outside the providers the catalogue covers
- step-5: creator outside the providers the catalogue covers
- tiny-aya-global: creator outside the providers the catalogue covers
- tri-21b-think-preview: creator outside the providers the catalogue covers
- tri-21b-think-v0-5: creator outside the providers the catalogue covers
- tulu3-405b: creator outside the providers the catalogue covers
Data sourced from Artificial Analysis. Licence: Artificial Analysis commercial data licence.