Models / Mistral Medium 3.5

Mistral

Mistral Medium 3.5

39 published results from 5 sources. Each card shows where the number comes from and what it does not measure. Results are never combined into one score.

Provider
Mistral
Sources
5
Our benchmarks
3
Price
Not yet published

Measured by Spring Prompt

Measured by Spring Prompt · BulletBench
555
Ladder Elo · rank 2 of 16
Unit
ladder Elo, higher is better
Range
396 to 765
Sample
8 games
Configuration
Mistral Medium 3.5, provider default reasoning
Measured
29 Sep 2026
Not shown
Not a business skill: chess against an engine on a real clock, used here as a speed-under-pressure signal.
Measured by Spring Prompt · BulletBench
0.5 s
Median move time · rank 1 of 16
Unit
milliseconds, lower is better
Configuration
Mistral Medium 3.5, provider default reasoning
Measured
29 Sep 2026
Not shown
Not general response speed: replies are one short move.
Measured by Spring Prompt · CatalogBench
93.7%
Content quality · rank 16 of 18
Unit
% of checks, higher is better
Configuration
Mistral Medium 3.5, provider default reasoning
Measured
30 Sep 2026
Not shown
Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.
Measured by Spring Prompt · CatalogBench
0.0%
Failed outputs · rank 1 of 18
Unit
% of products, lower is better
Configuration
Mistral Medium 3.5, provider default reasoning
Measured
30 Sep 2026
Not shown
Not a provider outage: provider errors are retried before a product counts as failed.
Measured by Spring Prompt · CatalogBench
0.0%
Publish-ready listings · rank 15 of 18
Unit
% of products, higher is better
Configuration
Mistral Medium 3.5, provider default reasoning
Measured
30 Sep 2026
Not shown
Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.
Measured by Spring Prompt · CatalogBench
0.0%
Reliably publish-ready · rank 10 of 18
Unit
% of products, higher is better
Configuration
Mistral Medium 3.5, provider default reasoning
Measured
30 Sep 2026
Not shown
Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.
Measured by Spring Prompt · CatalogBench
9.12
Unsupported claims · rank 17 of 18
Unit
claims per product, lower is better
Configuration
Mistral Medium 3.5, provider default reasoning
Measured
30 Sep 2026
Not shown
Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.
Measured by Spring Prompt · CatalogBench
95.8%
Channel compliance · rank 16 of 18
Unit
% of products, higher is better
Configuration
Mistral Medium 3.5, provider default reasoning
Measured
30 Sep 2026
Not shown
Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.
Measured by Spring Prompt · CatalogBench
90.9%
Conflicts caught · rank 17 of 18
Unit
% of conflicts, higher is better
Configuration
Mistral Medium 3.5, provider default reasoning
Measured
30 Sep 2026
Not shown
Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.
Measured by Spring Prompt · CatalogBench
94.5%
Content quality · rank 16 of 18
Unit
% of checks, higher is better
Configuration
Mistral Medium 3.5, provider default reasoning
Measured
30 Sep 2026
Not shown
Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.
Measured by Spring Prompt · CatalogBench
$0.0080
Cost per product · rank 6 of 18
Unit
US dollars, lower is better
Configuration
Mistral Medium 3.5, provider default reasoning
Measured
30 Sep 2026
Not shown
Not your cost: prices are those charged through OpenRouter on the run date.
Measured by Spring Prompt · CatalogBench
90.5%
Decision accuracy · rank 16 of 18
Unit
% of decisions, higher is better
Configuration
Mistral Medium 3.5, provider default reasoning
Measured
30 Sep 2026
Not shown
Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.
Measured by Spring Prompt · CatalogBench
0.0%
Failed outputs · rank 1 of 18
Unit
% of products, lower is better
Configuration
Mistral Medium 3.5, provider default reasoning
Measured
30 Sep 2026
Not shown
Not a provider outage: provider errors are retried before a product counts as failed.
Measured by Spring Prompt · CatalogBench
91.7%
Field accuracy · rank 15 of 18
Unit
% of missing fields, higher is better
Configuration
Mistral Medium 3.5, provider default reasoning
Measured
30 Sep 2026
Not shown
Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.
Measured by Spring Prompt · CatalogBench
0.0%
Invented values · rank 1 of 18
Unit
% of filled values, lower is better
Configuration
Mistral Medium 3.5, provider default reasoning
Measured
30 Sep 2026
Not shown
Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.
Measured by Spring Prompt · CatalogBench
15.5%
Publish-ready listings · rank 15 of 18
Unit
% of products, higher is better
Configuration
Mistral Medium 3.5, provider default reasoning
Measured
30 Sep 2026
Not shown
Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.
Measured by Spring Prompt · CatalogBench
5.4%
Reliably publish-ready · rank 15 of 18
Unit
% of products, higher is better
Configuration
Mistral Medium 3.5, provider default reasoning
Measured
30 Sep 2026
Not shown
Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.
Measured by Spring Prompt · CatalogBench
3.07
Unsupported claims · rank 16 of 18
Unit
claims per product, lower is better
Configuration
Mistral Medium 3.5, provider default reasoning
Measured
30 Sep 2026
Not shown
Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.
Measured by Spring Prompt · ROASBench
$0.15
Cost of a run · rank 5 of 17
Unit
US dollars, lower is better
Configuration
Mistral Medium 3.5, provider default reasoning
Measured
29 Sep 2026
Not shown
Not your cost: prices are those charged through OpenRouter on the run date.
Measured by Spring Prompt · ROASBench
3
Months over budget · rank 17 of 17
Unit
months of 12, lower is better
Configuration
Mistral Medium 3.5, provider default reasoning
Measured
29 Sep 2026
Not shown
Not real ad performance: the market is a deterministic simulation of one invented skincare brand.
Measured by Spring Prompt · ROASBench
15.2
Overall score · rank 17 of 17
Unit
score out of 100, higher is better
Configuration
Mistral Medium 3.5, provider default reasoning
Measured
29 Sep 2026
Not shown
Not real ad performance: the market is a deterministic simulation of one invented skincare brand.
Measured by Spring Prompt · ROASBench
−£0.17
Return on ad spend · rank 16 of 17
Unit
profit per £1 spent, higher is better
Configuration
Mistral Medium 3.5, provider default reasoning
Measured
29 Sep 2026
Not shown
Not real ad performance: the market is a deterministic simulation of one invented skincare brand.

Reported by others

Reported by Arena (formerly LMArena)
-0.16
Confirmed task success · rank 40 of 46
Unit
IPS effect estimate, higher is better
Range
-0.20 to -0.13
Sample
6429 observations
Configuration
Mistral Medium 3.5
Measured
28 Sep 2026
Not shown
Not a success rate: the estimated effect of choosing this model as the agent's orchestrator, against an even mix of the models tested, inside Arena's own harness.
Reported by Arena (formerly LMArena)
-0.15
Praise over complaint · rank 38 of 46
Unit
IPS effect estimate, higher is better
Range
-0.19 to -0.11
Sample
2310 observations
Configuration
Mistral Medium 3.5
Measured
28 Sep 2026
Not shown
Not a success rate: the estimated effect of choosing this model as the agent's orchestrator, against an even mix of the models tested, inside Arena's own harness.
Reported by Arena (formerly LMArena)
-0.07
Steerability · rank 31 of 46
Unit
IPS effect estimate, higher is better
Range
-0.10 to -0.04
Sample
7189 observations
Configuration
Mistral Medium 3.5
Measured
28 Sep 2026
Not shown
Not a success rate: the estimated effect of choosing this model as the agent's orchestrator, against an even mix of the models tested, inside Arena's own harness.
Reported by Arena (formerly LMArena)
-0.02
Tool grounding · rank 44 of 46
Unit
IPS effect estimate, higher is better
Range
-0.03 to -0.02
Sample
357598 observations
Configuration
Mistral Medium 3.5
Measured
28 Sep 2026
Not shown
Not a success rate: the estimated effect of choosing this model as the agent's orchestrator, against an even mix of the models tested, inside Arena's own harness.
Reported by Arena (formerly LMArena)
1,430
Overall · rank 84 of 177
Unit
Arena rating, higher is better
Range
1,424 to 1,436
Sample
11632 votes
Configuration
Mistral Medium 3.5
Measured
25 Sep 2026
Not shown
Not an error rate: claims that cannot be checked on the web are skipped, and preference still carries most of the weight.
Reported by Arena (formerly LMArena)
1,430
Business, management and finance · rank 67 of 402
Unit
Arena rating, higher is better
Range
1,417 to 1,443
Sample
2256 votes
Configuration
Mistral Medium 3.5
Measured
25 Sep 2026
Not shown
Not accuracy or correctness: it ranks which answer voters preferred, with answer length and formatting controlled for.
Reported by Arena (formerly LMArena)
1,398
Creative writing · rank 79 of 407
Unit
Arena rating, higher is better
Range
1,384 to 1,412
Sample
1999 votes
Configuration
Mistral Medium 3.5
Measured
25 Sep 2026
Not shown
Not accuracy or correctness: it ranks which answer voters preferred, with answer length and formatting controlled for.
Reported by Arena (formerly LMArena)
1,434
Expert prompts · rank 93 of 359
Unit
Arena rating, higher is better
Range
1,416 to 1,451
Sample
1205 votes
Configuration
Mistral Medium 3.5
Measured
25 Sep 2026
Not shown
Not accuracy or correctness: it ranks which answer voters preferred, with answer length and formatting controlled for.
Reported by Arena (formerly LMArena)
1,421
Instruction following · rank 77 of 409
Unit
Arena rating, higher is better
Range
1,411 to 1,431
Sample
3827 votes
Configuration
Mistral Medium 3.5
Measured
25 Sep 2026
Not shown
Not accuracy or correctness: it ranks which answer voters preferred, with answer length and formatting controlled for.
Reported by Arena (formerly LMArena)
1,426
Overall · rank 95 of 409
Unit
Arena rating, higher is better
Range
1,420 to 1,433
Sample
11693 votes
Configuration
Mistral Medium 3.5
Measured
25 Sep 2026
Not shown
Not accuracy or correctness: it ranks which answer voters preferred, with answer length and formatting controlled for.
Reported by Arena (formerly LMArena)
1,404
Writing, literature and language · rank 88 of 408
Unit
Arena rating, higher is better
Range
1,392 to 1,415
Sample
2919 votes
Configuration
Mistral Medium 3.5
Measured
25 Sep 2026
Not shown
Not accuracy or correctness: it ranks which answer voters preferred, with answer length and formatting controlled for.
Reported by UGI Leaderboard
60.0%
Requested-length error · rank 323 of 370
Unit
% off the requested word count, lower is better
Configuration
mistral-medium-3-5
Measured
21 May 2026
Not shown
Not other format limits such as character counts or bullet counts.
Reported by UGI Leaderboard
18.0%
Requested-length error · rank 150 of 370
Unit
% off the requested word count, lower is better
Configuration
mistral-medium-3-5
Measured
21 May 2026
Not shown
Not other format limits such as character counts or bullet counts.
Reported by UGI Leaderboard
0.31
Style adherence · rank 313 of 370
Unit
score from 0 to 1, higher is better
Configuration
mistral-medium-3-5
Measured
21 May 2026
Not shown
Not brand voice on your own examples: UGI's prompts are private and lean towards creative writing.
Reported by UGI Leaderboard
0.35
Style adherence · rank 190 of 370
Unit
score from 0 to 1, higher is better
Configuration
mistral-medium-3-5
Measured
21 May 2026
Not shown
Not brand voice on your own examples: UGI's prompts are private and lean towards creative writing.
Reported by UGI Leaderboard
43.9
Writing score · rank 185 of 370
Unit
score out of 100, higher is better
Configuration
mistral-medium-3-5
Measured
21 May 2026
Not shown
Not business copy quality: UGI's prompts are private and lean towards creative writing, and models that often refuse get no score.
Reported by UGI Leaderboard
45.5
Writing score · rank 174 of 370
Unit
score out of 100, higher is better
Configuration
mistral-medium-3-5
Measured
21 May 2026
Not shown
Not business copy quality: UGI's prompts are private and lean towards creative writing, and models that often refuse get no score.

Compare Mistral Medium 3.5 with