Compare / Claude Haiku 4.5 vs Ministral 3 8B 2512

Claude Haiku 4.5 vs Ministral 3 8B 2512

5 results from 2 sources that measured both models. Each row is in the source's own units; there is no overall winner.

Claude Haiku 4.5
Anthropic · profile
Ministral 3 8B 2512
Mistral · profile
Results compared
5
Shared sources
2
BenchmarkMetricClaude Haiku 4.5Ministral 3 8B 2512
UGI LeaderboardreportedRequested-length error% off the requested word count 6.0%23.0%
UGI LeaderboardreportedStyle adherencescore from 0 to 1 0.390.33
UGI LeaderboardreportedWriting scorescore out of 100 52.228.8
Vectara Hallucination LeaderboardreportedAnswer rate% of documents 99.5%99.1%
Vectara Hallucination LeaderboardreportedHallucination rate% of summaries 9.8%21.7%

Bold green marks the better value on that metric. Where a source reports ranges that overlap, the difference may not be meaningful; see the benchmark page for ranges.