Compare / Claude Haiku 4.5 vs Gemini 2.5 Flash Lite

Claude Haiku 4.5 vs Gemini 2.5 Flash Lite

10 results from 2 sources that measured both models. Each row is in the source's own units; there is no overall winner.

Claude Haiku 4.5
Anthropic · profile
Gemini 2.5 Flash Lite
Google · profile
Results compared
10
Shared sources
2
BenchmarkMetricClaude Haiku 4.5Gemini 2.5 Flash Lite
Berkeley Function Calling Leaderboard (BFCL) V4reportedIrrelevance detection% correct 95.3%93.3%
Berkeley Function Calling Leaderboard (BFCL) V4reportedMemory% correct 54.4%20.6%
Berkeley Function Calling Leaderboard (BFCL) V4reportedMulti-turn tasks% correct 53.6%13.5%
Berkeley Function Calling Leaderboard (BFCL) V4reportedOverall accuracy% correct 68.7%36.9%
Berkeley Function Calling Leaderboard (BFCL) V4reportedRelevance detection% correct 62.5%50.0%
Berkeley Function Calling Leaderboard (BFCL) V4reportedSingle-turn calls (curated)% correct 86.5%86.6%
Berkeley Function Calling Leaderboard (BFCL) V4reportedSingle-turn calls (user-contributed)% correct 78.7%65.8%
Berkeley Function Calling Leaderboard (BFCL) V4reportedWeb search% correct 83.5%21.0%
Vectara Hallucination LeaderboardreportedAnswer rate% of documents 99.5%99.5%
Vectara Hallucination LeaderboardreportedHallucination rate% of summaries 9.8%3.3%

Bold green marks the better value on that metric. Where a source reports ranges that overlap, the difference may not be meaningful; see the benchmark page for ranges.