Benchmarks / Artificial Analysis

Reported by Artificial Analysis

Artificial Analysis

Share of simulated telecom support tasks resolved with tools, as run by Artificial Analysis with its own harness and prompts.

Results dated
1 Oct 2026
Models
214
Unit
% of tasks
Licence
Artificial Analysis commercial data licence

Full results

Artificial Analysis: τ²-bench telecom, % of tasks, higher is better
#ModelArtificial Analysis: τ²-bench telecom
% of tasks, higher is better
1 GLM 5.2 (max)Z.ai
99.1%
2 GLM 4.7 FlashZ.ai
98.8%
3 Claude Fable 5 (max reasoning)Anthropic
98.5%
3 GLM 5 TurboZ.ai
98.5%
3 GLM 5V TurboZ.ai
98.5%
6 GLM 5Z.ai
98.2%
7 Qwen3.6 PlusAlibaba
97.7%
7 Grok 4.3 (high)xAI
97.7%
7 GLM 5.1Z.ai
97.7%
10 GLM 5 (no reasoning)Z.ai
97.4%
11 GLM 5.1 (no reasoning)Z.ai
97.1%
12 grok-4.20-0309-reasoningxAI
96.5%
13 deepseek-v4-pro-preview (max reasoning)DeepSeek
96.2%
14 Qwen3.6 Max PreviewAlibaba
95.9%
14 Kimi K2.5Moonshot AI
95.9%
14 Kimi K2.6Moonshot AI
95.9%
14 GLM 4.7Z.ai
95.9%
18 Qwen3.5 397B A17BAlibaba
95.6%
18 deepseek-v4-flash-preview (high reasoning)DeepSeek
95.6%
18 Gemini 3.1 Pro PreviewGoogle
95.6%
18 Gemini 3.5 Flash (medium)Google
95.6%
22 Qwen3.6 35B A3BAlibaba
95.3%
22 Gemini 3.5 Flash (high)Google
95.3%
24 deepseek-v4-flash-preview (max reasoning)DeepSeek
95.0%
25 Qwen3.7 MaxAlibaba
94.7%
26 Claude Opus 4.8 (max reasoning)Anthropic
94.4%
26 deepseek-v4-flash-preview (no reasoning)DeepSeek
94.4%
28 Qwen3.6 27BAlibaba
94.2%
28 deepseek-v4-pro-preview (high reasoning)DeepSeek
94.2%
28 Mistral Medium 3.5Mistral
94.2%
28 GLM 4.7 (no reasoning)Z.ai
94.2%
32 Qwen3.5-27BAlibaba
93.9%
32 Kimi K2.6 (no reasoning)Moonshot AI
93.9%
32 GPT-5.5 (xhigh reasoning)OpenAI
93.9%
35 Qwen3.5-122B-A10BAlibaba
93.6%
35 Qwen3.6 27B (no reasoning)Alibaba
93.6%
37 grok-4-1-fast-reasoningxAI
93.3%
38 Qwen3.7 PlusAlibaba
93.0%
38 Kimi K2 ThinkingMoonshot AI
93.0%
38 GPT-5.5 (high)OpenAI
93.0%
38 Grok 4.20xAI
93.0%
42 qwen3.5-4b (thinking reasoning)Alibaba
92.1%
42 Claude Opus 4.6 (max reasoning)Anthropic
92.1%
42 GPT-5.2-Codex (xhigh)OpenAI
92.1%
45 GPT-5.5 (medium reasoning)OpenAI
91.8%
45 GLM 4.7 Flash (no reasoning)Z.ai
91.8%
47 muse-sparkMeta
91.5%
48 deepseek-v4-pro-preview (no reasoning)DeepSeek
91.2%
48 Grok 4.3 (medium)xAI
91.2%
50 DeepSeek V3.2DeepSeek
90.6%
51 Kimi K2.7 CodeMoonshot AI
90.1%
52 Claude Opus 4.5 (thinking reasoning)Anthropic
89.5%
53 Qwen3.5-35B-A3BAlibaba
89.2%
54 Grok 4.3 (low)xAI
88.9%
55 Claude Opus 4.7 (max reasoning)Anthropic
88.6%
56 Qwen3.5 Omni PlusAlibaba
88.3%
57 qwen3.5-4b (no reasoning)Alibaba
87.7%
58 Qwen3.5-27B (no reasoning)Alibaba
87.1%
58 gemini-3-pro (high)Google
87.1%
58 GPT-5.4 (xhigh reasoning)OpenAI
87.1%
61 Qwen3.5-9BAlibaba
86.8%
61 GPT-5-Codex (high)OpenAI
86.8%
63 GPT-5 (medium)OpenAI
86.5%
64 Qwen3.5-35B-A3B (no reasoning)Alibaba
86.3%
64 Claude Opus 4.5 (no reasoning)Anthropic
86.3%
64 GPT-5.6 Terra (max)OpenAI
86.3%
67 GPT-5.3-Codex (xhigh)OpenAI
86.0%
68 Qwen3.5-9B (no reasoning)Alibaba
85.1%
68 Qwen3.6 35B A3B (no reasoning)Alibaba
85.1%
68 GPT-5.6 Sol (max)OpenAI
85.1%
71 Claude Opus 4.6 (off)Anthropic
84.8%
71 GPT-5.2 (xhigh)OpenAI
84.8%
71 GPT-5.6 Sol (xhigh)OpenAI
84.8%
71 GPT-5 (high)OpenAI
84.8%
75 Qwen3.5-122B-A10B (no reasoning)Alibaba
84.5%
75 Qwen3.5 Omni FlashAlibaba
84.5%
77 GPT-5 (low reasoning)OpenAI
84.2%
78 Qwen3.5 397B A17B (no reasoning)Alibaba
83.9%
78 GPT-5.5 (low reasoning)OpenAI
83.9%
80 Qwen3 Max Thinking (preview)Alibaba
83.6%
80 Qwen3 Max ThinkingAlibaba
83.6%
82 GPT-5.4 Mini (xhigh)OpenAI
83.3%
82 GPT-5.6 Sol (high reasoning)OpenAI
83.3%
84 GPT-5.1-Codex (high)OpenAI
83.0%
85 GPT-5.1 (high)OpenAI
81.9%
86 qwen3.5-2b (no reasoning)Alibaba
81.6%
87 Kimi K2.5Moonshot AI
81.3%
88 GPT-5.6 Sol (medium reasoning)OpenAI
81.0%
89 gemini-3-flash (thinking reasoning)Google
80.4%
89 GPT-5.6 Terra (xhigh)OpenAI
80.4%
91 Qwen3 Coder NextAlibaba
79.5%
91 Claude Sonnet 4.6 (off)Anthropic
79.5%
93 DeepSeek V3.2 (no reasoning)DeepSeek
78.9%
94 GPT-5.6 Terra (high reasoning)OpenAI
78.4%
95 Claude Sonnet 4.5 (thinking reasoning)Anthropic
78.1%
96 GLM 4.6 (no reasoning)Z.ai
76.9%
97 GPT-5.4 Nano (xhigh)OpenAI
76.0%
97 GPT-5.6 Sol (low reasoning)OpenAI
76.0%
99 Claude Sonnet 4.6 (max reasoning)Anthropic
75.7%
99 Grok Code Fast 1xAI
75.7%
101 grok-4xAI
74.9%
102 GPT-5.4 (low reasoning)OpenAI
74.6%
103 Qwen3 MaxAlibaba
74.3%
103 GPT-5.2 (medium reasoning)OpenAI
74.3%
105 Claude Opus 4.7 (off)Anthropic
74.0%
106 Kimi K2 0905Moonshot AI
73.4%
107 GPT-5.6 Terra (medium reasoning)OpenAI
72.8%
108 Claude Opus 4.1 (thinking reasoning)Anthropic
71.4%
109 GPT-5 Mini (medium)OpenAI
71.1%
110 Claude Sonnet 4.5 (no reasoning)Anthropic
70.5%
110 GLM 4.6 (thinking reasoning)Z.ai
70.5%
112 grok-4.20-0309-non-reasoning (no reasoning)xAI
69.6%
113 GPT-5.5 (no reasoning)OpenAI
69.3%
114 qwen3.5-2b (thinking reasoning)Alibaba
69.0%
115 GPT-5 Mini (high)OpenAI
68.4%
116 gemini-3-pro (low)Google
68.1%
117 GPT-5 (minimal reasoning)OpenAI
67.0%
118 gpt-oss-120b (high)OpenAI
65.8%
118 Grok 4.3 (off)xAI
65.8%
118 grok-4-fast-reasoningxAI
65.8%
121 Gemma 4 31B (off)Google
65.5%
122 qwen3.5-0.8b (no reasoning)Alibaba
65.2%
123 grok-4-1-fast-non-reasoning (no reasoning)xAI
63.7%
123 grok-4-fast-non-reasoning (no reasoning)xAI
63.7%
125 GPT-5.1-Codex-Mini (high)OpenAI
62.9%
126 Kimi K2 0711Moonshot AI
61.1%
127 GPT-5.6 Terra (low reasoning)OpenAI
60.5%
128 gpt-oss-20b (high reasoning)OpenAI
60.2%
129 Gemma 4 31BGoogle
59.9%
129 Grok 4.20 (off)xAI
59.9%
131 Gemini 3.5 Flash (minimal reasoning)Google
58.8%
132 Claude Haiku 4.5 (thinking reasoning)Anthropic
54.7%
133 Qwen3 VL 235B A22B ThinkingAlibaba
54.1%
134 Qwen3 235B A22B Thinking 2507Alibaba
53.2%
135 GPT-5.4 Nano (medium)OpenAI
52.6%
136 Magistral Medium 1.2Mistral
52.0%
137 gpt-oss-20b (low reasoning)OpenAI
50.3%
138 GPT-5.5 Instant (26 May)OpenAI
49.4%
139 qwen3.5-0.8b (thinking reasoning)Alibaba
47.7%
140 GPT-5.1 (off)OpenAI
46.5%
140 GPT-5.2 (no reasoning)OpenAI
46.5%
140 GLM 4.5 AirZ.ai
46.5%
143 qwen3-vl-32b-thinkingAlibaba
45.6%
143 gemini-2.5-flash-preview-09-2025 (thinking reasoning)Google
45.6%
145 gpt-oss-120b (low)OpenAI
45.0%
146 Qwen3 Coder 480B A35BAlibaba
43.6%
146 Gemma 4 26B A4BGoogle
43.6%
148 gemini-3-flash (off)Google
43.3%
149 GLM 4.5Z.ai
43.0%
150 Qwen3 Next 80B A3B ThinkingAlibaba
41.5%
151 Mistral Small 4Mistral
41.2%
152 Mistral Medium 3.1Mistral
40.6%
153 Gemma 4 26B A4B (off)Google
40.4%
154 DeepSeek V3.1DeepSeek
37.4%
155 DeepSeek V3.1 Terminus (no reasoning)DeepSeek
37.1%
155 DeepSeek V3.1 TerminusDeepSeek
37.1%
157 GPT-5.4 Mini (medium)OpenAI
36.5%
157 GPT-5 Nano (high)OpenAI
36.5%
159 gemma-4-12b-itGoogle
36.3%
160 GPT-5.4 (no reasoning)OpenAI
36.0%
161 Qwen3 VL 235B A22B InstructAlibaba
35.1%
162 DeepSeek V3.1 (no reasoning)DeepSeek
34.8%
162 GPT-5.4 Nano (no reasoning)OpenAI
34.8%
164 Qwen3 Coder 30B A3B InstructAlibaba
34.5%
165 DeepSeek V3.2 Exp (no reasoning)DeepSeek
33.9%
165 DeepSeek V3.2 ExpDeepSeek
33.9%
167 Qwen3 235B A22B Instruct 2507Alibaba
33.3%
168 qwen3-max-previewAlibaba
32.7%
169 Claude Haiku 4.5 (no reasoning)Anthropic
32.5%
170 gemma-4-12b-it (no reasoning)Google
31.9%
170 GPT-5 Mini (minimal)OpenAI
31.9%
172 GLM 4.6V (thinking reasoning)Z.ai
31.6%
173 Gemini 3.1 Flash Lite PreviewGoogle
31.3%
174 gemini-2.5-flash-lite-preview-09-2025 (thinking reasoning)Google
30.7%
174 GLM 4.6V (no reasoning)Z.ai
30.7%
176 gemini-2.5-flash-lite-preview-09-2025 (no reasoning)Google
30.4%
176 GPT-5 Nano (medium)OpenAI
30.4%
178 Qwen3 VL 32B InstructAlibaba
29.2%
178 Qwen3 VL 8B InstructAlibaba
29.2%
180 gemini-2.5-flash-preview-09-2025 (no reasoning)Google
28.4%
180 Devstral Small 1.1Mistral
28.4%
182 Qwen3 30B A3B Thinking 2507Alibaba
28.1%
183 magistral-small-2509Mistral
27.8%
184 Ministral 3 14B 2512Mistral
27.2%
185 qwen3-4b-instruct-2507Alibaba
26.6%
185 Ministral 3 8B 2512Mistral
26.6%
187 gemma-4-e4b-it (no reasoning)Google
26.0%
188 GPT-5 Nano (minimal)OpenAI
25.7%
189 qwen3-4b-thinking-2507Alibaba
25.4%
190 Devstral 2 2512Mistral
24.9%
190 Ministral 3 3B 2512Mistral
24.9%
192 Mistral Large 3 2512Mistral
24.6%
193 qwen3-vl-4b-instructAlibaba
23.4%
193 devstral-small-2-24b-instruct-2512Mistral
23.4%
193 GPT-5.4 Mini (no reasoning)OpenAI
23.4%
196 Qwen3 VL 8B ThinkingAlibaba
22.5%
196 GLM 4.5V (thinking reasoning)Z.ai
22.5%
198 gemma-4-e2b-it (no reasoning)Google
22.2%
199 Qwen3 Next 80B A3B InstructAlibaba
21.6%
200 qwen3-omni-30b-a3b-thinkingAlibaba
21.3%
201 gemma-4-e2b-itGoogle
20.8%
201 gemma-4-e4b-itGoogle
20.8%
203 Qwen3 VL 30B A3B ThinkingAlibaba
19.9%
203 Devstral MediumMistral
19.9%
205 GLM 4.5V (off)Z.ai
19.6%
206 Qwen3 VL 30B A3B InstructAlibaba
19.0%
207 Mistral Small 4 (no reasoning)Mistral
18.4%
208 Qwen3 Omni 30B A3B InstructAlibaba
16.4%
209 qwen3-vl-4b-thinkingAlibaba
15.5%
210 Qwen3 30B A3B Instruct 2507Alibaba
10.2%
211 Gemma 3 270MGoogle
9.1%
212 deepseek-v3.2-specialeDeepSeek
0.0%
212 kimi-linear-48b-a3b-instructMoonshot AI
0.0%
212 gpt-5-chatOpenAI
0.0%

Results as published by Artificial Analysis; we do not re-run them.

What it measures

Share of simulated telecom support tasks resolved with tools, as run by Artificial Analysis with its own harness and prompts.

What it does not measure

Not your policies or systems; no longer run on new models.

Source

Artificial Analysis · Methodology

Failures

Failures count against a model: a product with no usable output is a failed listing. They are listed here so you can see why.

Not ranked

  • Command A: creator outside the providers the catalogue covers
  • GPT-4 Turbo: released before 2025-07-01
  • GPT-4o (2024-05-13): released before 2025-07-01
  • GPT-4o (2024-08-06): released before 2025-07-01
  • Hy3: creator outside the providers the catalogue covers
  • Hy3 preview: creator outside the providers the catalogue covers
  • Inkling: creator outside the providers the catalogue covers
  • Inkling Small: creator outside the providers the catalogue covers
  • Llama 4 Maverick: released before 2025-07-01
  • Llama 4 Scout: released before 2025-07-01
  • Mercury 2: creator outside the providers the catalogue covers
  • MiniMax M2: creator outside the providers the catalogue covers
  • MiniMax M3: creator outside the providers the catalogue covers
  • Mistral Large 2407: released before 2025-07-01
  • Mistral Medium 3: released before 2025-07-01
  • Phi 4: creator outside the providers the catalogue covers
  • QwQ-32B-Preview: released before 2025-07-01
  • R1: released before 2025-07-01
  • Reka Flash 3: creator outside the providers the catalogue covers
  • Solar Pro 3: creator outside the providers the catalogue covers
  • Solar Pro 4: creator outside the providers the catalogue covers
  • Trinity Large Thinking: creator outside the providers the catalogue covers
  • a-x-k2: creator outside the providers the catalogue covers
  • apertus-70b-instruct: creator outside the providers the catalogue covers
  • apertus-8b-instruct: creator outside the providers the catalogue covers
  • apodex-1-1: creator outside the providers the catalogue covers
  • apriel-v1-5-15b-thinker: creator outside the providers the catalogue covers
  • apriel-v1-6-15b-thinker: creator outside the providers the catalogue covers
  • arctic-instruct: creator outside the providers the catalogue covers
  • celeris-1: creator outside the providers the catalogue covers
  • claude-2: released before 2025-07-01
  • claude-21: released before 2025-07-01
  • claude-3-5-haiku: released before 2025-07-01
  • claude-3-7-sonnet: released before 2025-07-01
  • claude-3-7-sonnet-thinking: released before 2025-07-01
  • claude-3-haiku: released before 2025-07-01
  • claude-3-opus: released before 2025-07-01
  • claude-3-sonnet: released before 2025-07-01
  • claude-35-sonnet: released before 2025-07-01
  • claude-35-sonnet-june-24: released before 2025-07-01
  • claude-4-opus: released before 2025-07-01
  • claude-4-opus-thinking: released before 2025-07-01
  • claude-4-sonnet: released before 2025-07-01
  • claude-4-sonnet-thinking: released before 2025-07-01
  • claude-instant: released before 2025-07-01
  • claude-sonnet-4-6-non-reasoning-low-effort: non-standard setting combination
  • cogito-v2-1-reasoning: creator outside the providers the catalogue covers
  • command-a-plus: creator outside the providers the catalogue covers
  • command-r-03-2024: creator outside the providers the catalogue covers
  • command-r-plus-04-2024: creator outside the providers the catalogue covers
  • dbrx: creator outside the providers the catalogue covers
  • deephermes-3-llama-3-1-8b-preview: creator outside the providers the catalogue covers
  • deephermes-3-mistral-24b-preview: creator outside the providers the catalogue covers
  • deepseek-coder-v2: released before 2025-07-01
  • deepseek-coder-v2-lite: released before 2025-07-01
  • deepseek-llm-67b-chat: released before 2025-07-01
  • deepseek-r1-0120: released before 2025-07-01
  • deepseek-r1-distill-llama-70b: released before 2025-07-01
  • deepseek-r1-distill-llama-8b: released before 2025-07-01
  • deepseek-r1-distill-qwen-1-5b: released before 2025-07-01
  • deepseek-r1-distill-qwen-14b: released before 2025-07-01
  • deepseek-r1-distill-qwen-32b: released before 2025-07-01
  • deepseek-r1-qwen3-8b: released before 2025-07-01
  • deepseek-v2: released before 2025-07-01
  • deepseek-v2-5: released before 2025-07-01
  • deepseek-v2-5-sep-2024: released before 2025-07-01
  • deepseek-v3: released before 2025-07-01
  • deepseek-v3-0324: released before 2025-07-01
  • devstral-small-2505: released before 2025-07-01
  • doubao-seed-code: creator outside the providers the catalogue covers
  • ernie-4-5-300b-a47b: creator outside the providers the catalogue covers
  • ernie-5-0-thinking-preview: creator outside the providers the catalogue covers
  • exaone-4-0-1-2b: creator outside the providers the catalogue covers
  • exaone-4-0-1-2b-reasoning: creator outside the providers the catalogue covers
  • exaone-4-0-32b: creator outside the providers the catalogue covers
  • exaone-4-0-32b-reasoning: creator outside the providers the catalogue covers
  • exaone-4-5-33b: creator outside the providers the catalogue covers
  • falcon-h1r-7b: creator outside the providers the catalogue covers
  • g9v3-39a5b: creator outside the providers the catalogue covers
  • g9v3-3b: creator outside the providers the catalogue covers
  • gemini-1-0-pro: released before 2025-07-01
  • gemini-1-0-ultra: released before 2025-07-01
  • gemini-1-5-flash: released before 2025-07-01
  • gemini-1-5-flash-8b: released before 2025-07-01
  • gemini-1-5-flash-may-2024: released before 2025-07-01
  • gemini-1-5-pro: released before 2025-07-01
  • gemini-1-5-pro-may-2024: released before 2025-07-01
  • gemini-2-0-flash: released before 2025-07-01
  • gemini-2-0-flash-experimental: released before 2025-07-01
  • gemini-2-0-flash-lite-001: released before 2025-07-01
  • gemini-2-0-flash-lite-preview: released before 2025-07-01
  • gemini-2-0-flash-thinking-exp-0121: released before 2025-07-01
  • gemini-2-0-flash-thinking-exp-1219: released before 2025-07-01
  • gemini-2-0-pro-experimental-02-05: released before 2025-07-01
  • gemini-2-5-flash: released before 2025-07-01
  • gemini-2-5-flash-04-2025: released before 2025-07-01
  • gemini-2-5-flash-lite: released before 2025-07-01
  • gemini-2-5-flash-lite-reasoning: released before 2025-07-01
  • gemini-2-5-flash-reasoning: released before 2025-07-01
  • gemini-2-5-flash-reasoning-04-2025: released before 2025-07-01
  • gemini-2-5-pro: released before 2025-07-01
  • gemini-2-5-pro-03-25: released before 2025-07-01
  • gemini-2-5-pro-05-06: released before 2025-07-01
  • gemma-3-12b: released before 2025-07-01
  • gemma-3-1b: released before 2025-07-01
  • gemma-3-27b: released before 2025-07-01
  • gemma-3-4b: released before 2025-07-01
  • gemma-3n-e2b: released before 2025-07-01
  • gemma-3n-e4b: released before 2025-07-01
  • gemma-3n-e4b-preview-0520: released before 2025-07-01
  • gpt-35-turbo: released before 2025-07-01
  • gpt-4: released before 2025-07-01
  • gpt-4-1: released before 2025-07-01
  • gpt-4-1-mini: released before 2025-07-01
  • gpt-4-1-nano: released before 2025-07-01
  • gpt-4-5: released before 2025-07-01
  • gpt-4o: released before 2025-07-01
  • gpt-4o-chatgpt: released before 2025-07-01
  • gpt-4o-chatgpt-03-25: released before 2025-07-01
  • gpt-4o-mini: released before 2025-07-01
  • granite-3-3-8b-instruct: creator outside the providers the catalogue covers
  • granite-4-0-350m: creator outside the providers the catalogue covers
  • granite-4-0-h-350m: creator outside the providers the catalogue covers
  • granite-4-0-h-nano-1b: creator outside the providers the catalogue covers
  • granite-4-0-h-small: creator outside the providers the catalogue covers
  • granite-4-0-micro: creator outside the providers the catalogue covers
  • granite-4-0-nano-1b: creator outside the providers the catalogue covers
  • granite-4-1-30b: creator outside the providers the catalogue covers
  • granite-4-1-3b: creator outside the providers the catalogue covers
  • granite-4-1-8b: creator outside the providers the catalogue covers
  • granite-4-2-30b: creator outside the providers the catalogue covers
  • granite-4-2-3b: creator outside the providers the catalogue covers
  • granite-4-2-8b: creator outside the providers the catalogue covers
  • grok-1: released before 2025-07-01
  • grok-2-1212: released before 2025-07-01
  • grok-3: released before 2025-07-01
  • grok-3-mini-reasoning: released before 2025-07-01
  • grok-3-reasoning: released before 2025-07-01
  • grok-beta: released before 2025-07-01
  • hermes-3-llama-3-1-70b: creator outside the providers the catalogue covers
  • hermes-4-llama-3-1-405b: creator outside the providers the catalogue covers
  • hermes-4-llama-3-1-405b-reasoning: creator outside the providers the catalogue covers
  • hermes-4-llama-3-1-70b: creator outside the providers the catalogue covers
  • hermes-4-llama-3-1-70b-reasoning: creator outside the providers the catalogue covers
  • hy3-non-reasoning: creator outside the providers the catalogue covers
  • hyperclova-x-seed-think-32b: creator outside the providers the catalogue covers
  • hypernova-60b: creator outside the providers the catalogue covers
  • intellect-3: creator outside the providers the catalogue covers
  • jamba-1-5-large: creator outside the providers the catalogue covers
  • jamba-1-5-mini: creator outside the providers the catalogue covers
  • jamba-1-6-large: creator outside the providers the catalogue covers
  • jamba-1-6-mini: creator outside the providers the catalogue covers
  • jamba-1-7-large: creator outside the providers the catalogue covers
  • jamba-1-7-mini: creator outside the providers the catalogue covers
  • jamba-reasoning-3b: creator outside the providers the catalogue covers
  • jt-35b-flash: creator outside the providers the catalogue covers
  • jt-4-1-flash-236b-a21b: creator outside the providers the catalogue covers
  • jt-mini: creator outside the providers the catalogue covers
  • jt236b: creator outside the providers the catalogue covers
  • k-exaone: creator outside the providers the catalogue covers
  • k-exaone-2-0-0803: creator outside the providers the catalogue covers
  • k-exaone-non-reasoning: creator outside the providers the catalogue covers
  • k2-horizon-0-9b: creator outside the providers the catalogue covers
  • k2-horizon-3-7b: creator outside the providers the catalogue covers
  • k2-horizon-375b-a23b: creator outside the providers the catalogue covers
  • k2-horizon-7b: creator outside the providers the catalogue covers
  • k2-horizon-mova-36b-a4b: creator outside the providers the catalogue covers
  • k2-think-v2: creator outside the providers the catalogue covers
  • k2-v2: creator outside the providers the catalogue covers
  • k2-v2-low: creator outside the providers the catalogue covers
  • k2-v2-medium: creator outside the providers the catalogue covers
  • kat-coder-pro-v1: creator outside the providers the catalogue covers
  • kat-coder-pro-v2: creator outside the providers the catalogue covers
  • lfm-40b: creator outside the providers the catalogue covers
  • lfm2-1-2b: creator outside the providers the catalogue covers
  • lfm2-2-6b: creator outside the providers the catalogue covers
  • lfm2-24b-a2b: creator outside the providers the catalogue covers
  • lfm2-5-1-2b-instruct: creator outside the providers the catalogue covers
  • lfm2-5-1-2b-thinking: creator outside the providers the catalogue covers
  • lfm2-5-2-6b: creator outside the providers the catalogue covers
  • lfm2-5-8b-a1b: creator outside the providers the catalogue covers
  • lfm2-5-vl-1-6b: creator outside the providers the catalogue covers
  • lfm2-8b-a1b: creator outside the providers the catalogue covers
  • ling-1t: creator outside the providers the catalogue covers
  • ling-2-6-1t: creator outside the providers the catalogue covers
  • ling-2-6-flash: creator outside the providers the catalogue covers
  • ling-3-0-flash: creator outside the providers the catalogue covers
  • ling-3-0-flash-fin: creator outside the providers the catalogue covers
  • ling-3-0-flash-vl: creator outside the providers the catalogue covers
  • ling-3-0-tiny: creator outside the providers the catalogue covers
  • ling-flash-2-0: creator outside the providers the catalogue covers
  • ling-mini-2-0: creator outside the providers the catalogue covers
  • llama-2-chat-13b: released before 2025-07-01
  • llama-2-chat-70b: released before 2025-07-01
  • llama-2-chat-7b: released before 2025-07-01
  • llama-3-1-instruct-405b: released before 2025-07-01
  • llama-3-1-instruct-70b: released before 2025-07-01
  • llama-3-1-instruct-8b: released before 2025-07-01
  • llama-3-1-nemotron-instruct-70b: creator outside the providers the catalogue covers
  • llama-3-1-nemotron-nano-4b-reasoning: creator outside the providers the catalogue covers
  • llama-3-1-nemotron-ultra-253b-v1-reasoning: creator outside the providers the catalogue covers
  • llama-3-2-instruct-11b-vision: released before 2025-07-01
  • llama-3-2-instruct-1b: released before 2025-07-01
  • llama-3-2-instruct-3b: released before 2025-07-01
  • llama-3-2-instruct-90b-vision: released before 2025-07-01
  • llama-3-3-instruct-70b: released before 2025-07-01
  • llama-3-3-nemotron-super-49b: creator outside the providers the catalogue covers
  • llama-3-3-nemotron-super-49b-reasoning: creator outside the providers the catalogue covers
  • llama-3-instruct-70b: released before 2025-07-01
  • llama-3-instruct-8b: released before 2025-07-01
  • llama-65b: released before 2025-07-01
  • llama-nemotron-super-49b-v1-5: creator outside the providers the catalogue covers
  • llama-nemotron-super-49b-v1-5-reasoning: creator outside the providers the catalogue covers
  • longcat-2-0: creator outside the providers the catalogue covers
  • longcat-flash-lite: creator outside the providers the catalogue covers
  • magistral-medium: released before 2025-07-01
  • magistral-small: released before 2025-07-01
  • mercury-2-5: creator outside the providers the catalogue covers
  • mi-dm-k-2-5-pro-dec28: creator outside the providers the catalogue covers
  • midm-250-pro-rsnsft: creator outside the providers the catalogue covers
  • mimo-v2-0206: creator outside the providers the catalogue covers
  • mimo-v2-5-0424: creator outside the providers the catalogue covers
  • mimo-v2-5-pro: creator outside the providers the catalogue covers
  • mimo-v2-5-pro-non-reasoning: creator outside the providers the catalogue covers
  • mimo-v2-6-flash: creator outside the providers the catalogue covers
  • mimo-v2-6-pro: creator outside the providers the catalogue covers
  • mimo-v2-flash: creator outside the providers the catalogue covers
  • mimo-v2-flash-reasoning: creator outside the providers the catalogue covers
  • mimo-v2-omni: creator outside the providers the catalogue covers
  • mimo-v2-omni-0327: creator outside the providers the catalogue covers
  • mimo-v2-pro: creator outside the providers the catalogue covers
  • minicpm-v4-6-1-3b: creator outside the providers the catalogue covers
  • minicpm5-1b: creator outside the providers the catalogue covers
  • minicpm5-1b-non-reasoning: creator outside the providers the catalogue covers
  • minicpm5-2b: creator outside the providers the catalogue covers
  • minimax-m1-40k: creator outside the providers the catalogue covers
  • minimax-m1-80k: creator outside the providers the catalogue covers
  • minimax-m2-1: creator outside the providers the catalogue covers
  • minimax-m2-5: creator outside the providers the catalogue covers
  • minimax-m2-7: creator outside the providers the catalogue covers
  • mistral-7b-instruct: released before 2025-07-01
  • mistral-8x22b-instruct: released before 2025-07-01
  • mistral-large: released before 2025-07-01
  • mistral-large-2: released before 2025-07-01
  • mistral-medium: released before 2025-07-01
  • mistral-saba: released before 2025-07-01
  • mistral-small: released before 2025-07-01
  • mistral-small-2402: released before 2025-07-01
  • mistral-small-3: released before 2025-07-01
  • mistral-small-3-1: released before 2025-07-01
  • mistral-small-3-2: released before 2025-07-01
  • mixtral-8x7b-instruct: released before 2025-07-01
  • molmo-7b-d: creator outside the providers the catalogue covers
  • molmo2-8b: creator outside the providers the catalogue covers
  • motif-0714: creator outside the providers the catalogue covers
  • motif-2-12-7b: creator outside the providers the catalogue covers
  • motif-3: creator outside the providers the catalogue covers
  • nanbeige4-1-3b: creator outside the providers the catalogue covers
  • nemotron-3-5-lightning: creator outside the providers the catalogue covers
  • nemotron-3-nano-omni-30b-a3b: creator outside the providers the catalogue covers
  • nemotron-cascade-2-30b-a3b: creator outside the providers the catalogue covers
  • nex-n2-pro: creator outside the providers the catalogue covers
  • north-mini-code: creator outside the providers the catalogue covers
  • nova-2-0-lite: creator outside the providers the catalogue covers
  • nova-2-0-lite-reasoning: creator outside the providers the catalogue covers
  • nova-2-0-lite-reasoning-low: creator outside the providers the catalogue covers
  • nova-2-0-lite-reasoning-medium: creator outside the providers the catalogue covers
  • nova-2-0-omni: creator outside the providers the catalogue covers
  • nova-2-0-omni-reasoning-low: creator outside the providers the catalogue covers
  • nova-2-0-omni-reasoning-medium: creator outside the providers the catalogue covers
  • nova-2-0-pro: creator outside the providers the catalogue covers
  • nova-2-0-pro-reasoning-low: creator outside the providers the catalogue covers
  • nova-2-0-pro-reasoning-medium: creator outside the providers the catalogue covers
  • nova-lite: creator outside the providers the catalogue covers
  • nova-micro: creator outside the providers the catalogue covers
  • nova-premier: creator outside the providers the catalogue covers
  • nova-pro: creator outside the providers the catalogue covers
  • nvidia-nemotron-3-nano-30b-a3b: creator outside the providers the catalogue covers
  • nvidia-nemotron-3-nano-30b-a3b-reasoning: creator outside the providers the catalogue covers
  • nvidia-nemotron-3-nano-4b: creator outside the providers the catalogue covers
  • nvidia-nemotron-3-super-120b-a12b: creator outside the providers the catalogue covers
  • nvidia-nemotron-3-ultra-550b-a55b: creator outside the providers the catalogue covers
  • nvidia-nemotron-nano-12b-v2-vl: creator outside the providers the catalogue covers
  • nvidia-nemotron-nano-12b-v2-vl-reasoning: creator outside the providers the catalogue covers
  • nvidia-nemotron-nano-9b-v2: creator outside the providers the catalogue covers
  • nvidia-nemotron-nano-9b-v2-reasoning: creator outside the providers the catalogue covers
  • o1: released before 2025-07-01
  • o1-mini: released before 2025-07-01
  • o1-preview: released before 2025-07-01
  • o1-pro: released before 2025-07-01
  • o3: released before 2025-07-01
  • o3 Mini: released before 2025-07-01
  • o3 Mini High: released before 2025-07-01
  • o3 Pro: released before 2025-07-01
  • o4 Mini: released before 2025-07-01
  • olmo-2-32b: creator outside the providers the catalogue covers
  • olmo-2-7b: creator outside the providers the catalogue covers
  • olmo-3-1-32b-instruct: creator outside the providers the catalogue covers
  • olmo-3-1-32b-think: creator outside the providers the catalogue covers
  • olmo-3-32b-think: creator outside the providers the catalogue covers
  • olmo-3-7b-instruct: creator outside the providers the catalogue covers
  • olmo-3-7b-think: creator outside the providers the catalogue covers
  • openchat-35: creator outside the providers the catalogue covers
  • palm-2: released before 2025-07-01
  • phi-3-mini: creator outside the providers the catalogue covers
  • phi-4-mini: creator outside the providers the catalogue covers
  • phi-4-multimodal: creator outside the providers the catalogue covers
  • pixtral-large-2411: released before 2025-07-01
  • quasar-438b: creator outside the providers the catalogue covers
  • qwen-2-5-max: released before 2025-07-01
  • qwen-chat-14b: released before 2025-07-01
  • qwen-chat-72b: released before 2025-07-01
  • qwen-turbo: released before 2025-07-01
  • qwen1.5-110b-chat: released before 2025-07-01
  • qwen2-5-72b-instruct: released before 2025-07-01
  • qwen2-5-coder-32b-instruct: released before 2025-07-01
  • qwen2-5-coder-7b-instruct: released before 2025-07-01
  • qwen2-72b-instruct: released before 2025-07-01
  • qwen2.5-32b-instruct: released before 2025-07-01
  • qwen3-0.6b-instruct: released before 2025-07-01
  • qwen3-0.6b-instruct-reasoning: released before 2025-07-01
  • qwen3-1.7b-instruct: released before 2025-07-01
  • qwen3-1.7b-instruct-reasoning: released before 2025-07-01
  • qwen3-14b-instruct: released before 2025-07-01
  • qwen3-14b-instruct-reasoning: released before 2025-07-01
  • qwen3-235b-a22b-instruct: released before 2025-07-01
  • qwen3-235b-a22b-instruct-reasoning: released before 2025-07-01
  • qwen3-30b-a3b-instruct: released before 2025-07-01
  • qwen3-30b-a3b-instruct-reasoning: released before 2025-07-01
  • qwen3-32b-instruct: released before 2025-07-01
  • qwen3-32b-instruct-reasoning: released before 2025-07-01
  • qwen3-4b-instruct: released before 2025-07-01
  • qwen3-4b-instruct-reasoning: released before 2025-07-01
  • qwen3-8b-instruct: released before 2025-07-01
  • qwen3-8b-instruct-reasoning: released before 2025-07-01
  • qwq-32b: released before 2025-07-01
  • r1-1776: creator outside the providers the catalogue covers
  • reka-flash: creator outside the providers the catalogue covers
  • ring-1t: creator outside the providers the catalogue covers
  • ring-2-6-1t: creator outside the providers the catalogue covers
  • ring-flash-2-0: creator outside the providers the catalogue covers
  • sarvam-105b: creator outside the providers the catalogue covers
  • sarvam-30b: creator outside the providers the catalogue covers
  • sarvam-m-reasoning: creator outside the providers the catalogue covers
  • seed-oss-36b-instruct: creator outside the providers the catalogue covers
  • solar-mini: creator outside the providers the catalogue covers
  • solar-mini4: creator outside the providers the catalogue covers
  • solar-open-100b-reasoning: creator outside the providers the catalogue covers
  • solar-open2-250b: creator outside the providers the catalogue covers
  • solar-pro-2: creator outside the providers the catalogue covers
  • solar-pro-2-preview: creator outside the providers the catalogue covers
  • solar-pro-2-preview-reasoning: creator outside the providers the catalogue covers
  • solar-pro-2-reasoning: creator outside the providers the catalogue covers
  • sonar: creator outside the providers the catalogue covers
  • sonar-pro: creator outside the providers the catalogue covers
  • sonar-reasoning: creator outside the providers the catalogue covers
  • sonar-reasoning-pro: creator outside the providers the catalogue covers
  • step-3-5-flash: creator outside the providers the catalogue covers
  • step-3-5-flash-0202: creator outside the providers the catalogue covers
  • step-3-7-flash: creator outside the providers the catalogue covers
  • step-3-vl-10b: creator outside the providers the catalogue covers
  • step-5: creator outside the providers the catalogue covers
  • tiny-aya-global: creator outside the providers the catalogue covers
  • tri-21b-think-preview: creator outside the providers the catalogue covers
  • tri-21b-think-v0-5: creator outside the providers the catalogue covers
  • tulu3-405b: creator outside the providers the catalogue covers

Data sourced from Artificial Analysis. Licence: Artificial Analysis commercial data licence.