Models / Mistral Medium 3

Mistral

Mistral Medium 3

25 published results from 3 sources. Each card shows where the number comes from and what it does not measure. Results are never combined into one score.

Provider
Mistral
Sources
3
Our benchmarks
0
Price
Not yet published

Reported by others

Reported by Arena (formerly LMArena)
1,387
Business, management and finance · rank 143 of 402
Unit
Arena rating, higher is better
Range
1,378 to 1,396
Sample
5085 votes
Configuration
Mistral Medium 3
Measured
25 Sep 2026
Not shown
Not accuracy or correctness: it ranks which answer voters preferred, with answer length and formatting controlled for.
Reported by Arena (formerly LMArena)
1,364
Creative writing · rank 130 of 407
Unit
Arena rating, higher is better
Range
1,354 to 1,374
Sample
4039 votes
Configuration
Mistral Medium 3
Measured
25 Sep 2026
Not shown
Not accuracy or correctness: it ranks which answer voters preferred, with answer length and formatting controlled for.
Reported by Arena (formerly LMArena)
1,379
Expert prompts · rank 161 of 359
Unit
Arena rating, higher is better
Range
1,365 to 1,393
Sample
1777 votes
Configuration
Mistral Medium 3
Measured
25 Sep 2026
Not shown
Not accuracy or correctness: it ranks which answer voters preferred, with answer length and formatting controlled for.
Reported by Arena (formerly LMArena)
1,366
Instruction following · rank 168 of 409
Unit
Arena rating, higher is better
Range
1,359 to 1,373
Sample
7888 votes
Configuration
Mistral Medium 3
Measured
25 Sep 2026
Not shown
Not accuracy or correctness: it ranks which answer voters preferred, with answer length and formatting controlled for.
Reported by Arena (formerly LMArena)
1,387
Overall · rank 160 of 409
Unit
Arena rating, higher is better
Range
1,383 to 1,392
Sample
32615 votes
Configuration
Mistral Medium 3
Measured
25 Sep 2026
Not shown
Not accuracy or correctness: it ranks which answer voters preferred, with answer length and formatting controlled for.
Reported by Arena (formerly LMArena)
1,370
Writing, literature and language · rank 145 of 408
Unit
Arena rating, higher is better
Range
1,363 to 1,378
Sample
7135 votes
Configuration
Mistral Medium 3
Measured
25 Sep 2026
Not shown
Not accuracy or correctness: it ranks which answer voters preferred, with answer length and formatting controlled for.
Reported by Berkeley Function Calling Leaderboard (BFCL) V4
74.5%
Irrelevance detection · rank 75 of 109
Unit
% correct, higher is better
Configuration
mistral-medium-3
Measured
16 Dec 2025
Not shown
Not general refusal or safety behaviour.
Reported by Berkeley Function Calling Leaderboard (BFCL) V4
92.0%
Irrelevance detection · rank 10 of 109
Unit
% correct, higher is better
Configuration
mistral-medium-3
Measured
16 Dec 2025
Not shown
Not general refusal or safety behaviour.
Reported by Berkeley Function Calling Leaderboard (BFCL) V4
21.7%
Memory · rank 40 of 109
Unit
% correct, higher is better
Configuration
mistral-medium-3
Measured
16 Dec 2025
Not shown
Not long-term personal memory in a product: sessions are BFCL's scripted ones.
Reported by Berkeley Function Calling Leaderboard (BFCL) V4
23.0%
Memory · rank 39 of 109
Unit
% correct, higher is better
Configuration
mistral-medium-3
Measured
16 Dec 2025
Not shown
Not long-term personal memory in a product: sessions are BFCL's scripted ones.
Reported by Berkeley Function Calling Leaderboard (BFCL) V4
9.9%
Multi-turn tasks · rank 69 of 109
Unit
% correct, higher is better
Configuration
mistral-medium-3
Measured
16 Dec 2025
Not shown
Not open-ended agent work: the tools and tasks are BFCL's simulated APIs.
Reported by Berkeley Function Calling Leaderboard (BFCL) V4
10.8%
Multi-turn tasks · rank 66 of 109
Unit
% correct, higher is better
Configuration
mistral-medium-3
Measured
16 Dec 2025
Not shown
Not open-ended agent work: the tools and tasks are BFCL's simulated APIs.
Reported by Berkeley Function Calling Leaderboard (BFCL) V4
37.7%
Overall accuracy · rank 48 of 109
Unit
% correct, higher is better
Configuration
mistral-medium-3
Measured
16 Dec 2025
Not shown
Not a neutral average: the weighting is BFCL's. Not reliability on your own tools: BFCL's functions and queries are a fixed test set, and a correct call is judged by its form, not by what it achieved.
Reported by Berkeley Function Calling Leaderboard (BFCL) V4
37.6%
Overall accuracy · rank 49 of 109
Unit
% correct, higher is better
Configuration
mistral-medium-3
Measured
16 Dec 2025
Not shown
Not a neutral average: the weighting is BFCL's. Not reliability on your own tools: BFCL's functions and queries are a fixed test set, and a correct call is judged by its form, not by what it achieved.
Reported by Berkeley Function Calling Leaderboard (BFCL) V4
75.0%
Relevance detection · rank 62 of 109
Unit
% correct, higher is better
Configuration
mistral-medium-3
Measured
16 Dec 2025
Not shown
Not whether the call itself was right; only that one was attempted.
Reported by Berkeley Function Calling Leaderboard (BFCL) V4
62.5%
Relevance detection · rank 91 of 109
Unit
% correct, higher is better
Configuration
mistral-medium-3
Measured
16 Dec 2025
Not shown
Not whether the call itself was right; only that one was attempted.
Reported by Berkeley Function Calling Leaderboard (BFCL) V4
85.3%
Single-turn calls (curated) · rank 42 of 109
Unit
% correct, higher is better
Configuration
mistral-medium-3
Measured
16 Dec 2025
Not shown
Not reliability on your own tools: BFCL's functions and queries are a fixed test set, and a correct call is judged by its form, not by what it achieved.
Reported by Berkeley Function Calling Leaderboard (BFCL) V4
67.4%
Single-turn calls (curated) · rank 94 of 109
Unit
% correct, higher is better
Configuration
mistral-medium-3
Measured
16 Dec 2025
Not shown
Not reliability on your own tools: BFCL's functions and queries are a fixed test set, and a correct call is judged by its form, not by what it achieved.
Reported by Berkeley Function Calling Leaderboard (BFCL) V4
66.0%
Single-turn calls (user-contributed) · rank 78 of 109
Unit
% correct, higher is better
Configuration
mistral-medium-3
Measured
16 Dec 2025
Not shown
Not reliability on your own tools: BFCL's functions and queries are a fixed test set, and a correct call is judged by its form, not by what it achieved.
Reported by Berkeley Function Calling Leaderboard (BFCL) V4
68.0%
Single-turn calls (user-contributed) · rank 68 of 109
Unit
% correct, higher is better
Configuration
mistral-medium-3
Measured
16 Dec 2025
Not shown
Not reliability on your own tools: BFCL's functions and queries are a fixed test set, and a correct call is judged by its form, not by what it achieved.
Reported by Berkeley Function Calling Leaderboard (BFCL) V4
39.0%
Web search · rank 31 of 109
Unit
% correct, higher is better
Configuration
mistral-medium-3
Measured
16 Dec 2025
Not shown
Not general research quality: questions have short, checkable answers.
Reported by Berkeley Function Calling Leaderboard (BFCL) V4
35.0%
Web search · rank 32 of 109
Unit
% correct, higher is better
Configuration
mistral-medium-3
Measured
16 Dec 2025
Not shown
Not general research quality: questions have short, checkable answers.
Reported by UGI Leaderboard
20.0%
Requested-length error · rank 179 of 370
Unit
% off the requested word count, lower is better
Configuration
Mistral Medium 3
Measured
1 Oct 2025
Not shown
Not other format limits such as character counts or bullet counts.
Reported by UGI Leaderboard
0.35
Style adherence · rank 166 of 370
Unit
score from 0 to 1, higher is better
Configuration
Mistral Medium 3
Measured
1 Oct 2025
Not shown
Not brand voice on your own examples: UGI's prompts are private and lean towards creative writing.
Reported by UGI Leaderboard
32.6
Writing score · rank 251 of 370
Unit
score out of 100, higher is better
Configuration
Mistral Medium 3
Measured
1 Oct 2025
Not shown
Not business copy quality: UGI's prompts are private and lean towards creative writing, and models that often refuse get no score.

Compare Mistral Medium 3 with