Models / ministral-8b-2410

Mistral

ministral-8b-2410

16 published results from 3 sources. Each card shows where the number comes from and what it does not measure. Results are never combined into one score.

Provider
Mistral
Sources
3
Our benchmarks
0
Price
Not yet published

Reported by others

1,235
Business, management and finance · rank 290 of 402
Unit
Arena rating, higher is better
Range
1,212 to 1,259
Sample
572 votes
Configuration
ministral-8b-2410
Measured
25 Sep 2026
Not shown
Not accuracy or correctness: it ranks which answer voters preferred, with answer length and formatting controlled for.
1,222
Creative writing · rank 285 of 407
Unit
Arena rating, higher is better
Range
1,200 to 1,244
Sample
678 votes
Configuration
ministral-8b-2410
Measured
25 Sep 2026
Not shown
Not accuracy or correctness: it ranks which answer voters preferred, with answer length and formatting controlled for.
1,238
Expert prompts · rank 268 of 359
Unit
Arena rating, higher is better
Range
1,208 to 1,268
Sample
332 votes
Configuration
ministral-8b-2410
Measured
25 Sep 2026
Not shown
Not accuracy or correctness: it ranks which answer voters preferred, with answer length and formatting controlled for.
1,211
Instruction following · rank 317 of 409
Unit
Arena rating, higher is better
Range
1,198 to 1,224
Sample
1946 votes
Configuration
ministral-8b-2410
Measured
25 Sep 2026
Not shown
Not accuracy or correctness: it ranks which answer voters preferred, with answer length and formatting controlled for.
1,238
Overall · rank 314 of 409
Unit
Arena rating, higher is better
Range
1,229 to 1,247
Sample
4781 votes
Configuration
ministral-8b-2410
Measured
25 Sep 2026
Not shown
Not accuracy or correctness: it ranks which answer voters preferred, with answer length and formatting controlled for.
1,226
Writing, literature and language · rank 303 of 408
Unit
Arena rating, higher is better
Range
1,210 to 1,242
Sample
1350 votes
Configuration
ministral-8b-2410
Measured
25 Sep 2026
Not shown
Not accuracy or correctness: it ranks which answer voters preferred, with answer length and formatting controlled for.
100.0%
Irrelevance detection · rank 1 of 109
Unit
% correct, higher is better
Configuration
ministral-8b-2410
Measured
16 Dec 2025
Not shown
Not general refusal or safety behaviour.
4.5%
Memory · rank 91 of 109
Unit
% correct, higher is better
Configuration
ministral-8b-2410
Measured
16 Dec 2025
Not shown
Not long-term personal memory in a product: sessions are BFCL's scripted ones.
0.0%
Multi-turn tasks · rank 105 of 109
Unit
% correct, higher is better
Configuration
ministral-8b-2410
Measured
16 Dec 2025
Not shown
Not open-ended agent work: the tools and tasks are BFCL's simulated APIs.
11.1%
Overall accuracy · rank 105 of 109
Unit
% correct, higher is better
Configuration
ministral-8b-2410
Measured
16 Dec 2025
Not shown
Not a neutral average: the weighting is BFCL's. Not reliability on your own tools: BFCL's functions and queries are a fixed test set, and a correct call is judged by its form, not by what it achieved.
0.0%
Relevance detection · rank 107 of 109
Unit
% correct, higher is better
Configuration
ministral-8b-2410
Measured
16 Dec 2025
Not shown
Not whether the call itself was right; only that one was attempted.
0.0%
Single-turn calls (curated) · rank 108 of 109
Unit
% correct, higher is better
Configuration
ministral-8b-2410
Measured
16 Dec 2025
Not shown
Not reliability on your own tools: BFCL's functions and queries are a fixed test set, and a correct call is judged by its form, not by what it achieved.
0.0%
Single-turn calls (user-contributed) · rank 108 of 109
Unit
% correct, higher is better
Configuration
ministral-8b-2410
Measured
16 Dec 2025
Not shown
Not reliability on your own tools: BFCL's functions and queries are a fixed test set, and a correct call is judged by its form, not by what it achieved.
1.0%
Web search · rank 81 of 109
Unit
% correct, higher is better
Configuration
ministral-8b-2410
Measured
16 Dec 2025
Not shown
Not general research quality: questions have short, checkable answers.
99.9%
Answer rate · rank 19 of 108
Unit
% of documents, higher is better
Configuration
ministral-8b-2410
Measured
22 Sep 2026
Not shown
Not a quality score: a low rate usually means content filters were triggered, and hallucination rates are measured on answered documents only.
7.4%
Hallucination rate · rank 35 of 108
Unit
% of summaries, lower is better
Configuration
ministral-8b-2410
Measured
22 Sep 2026
Not shown
Not errors in open questions or other tasks: only summarisation, judged by Vectara's own model (HHEM-2.3), not by people, on news-style documents rather than your data.

Compare ministral-8b-2410 with