Compare / Gemini 3.1 Pro Preview vs MiniMax M2.1

Gemini 3.1 Pro Preview vs MiniMax M2.1

11 results from 3 sources that measured both models. Each row is in the source's own units; there is no overall winner.

Gemini 3.1 Pro Preview
Google · profile
MiniMax M2.1
MiniMax · profile
Results compared
11
Shared sources
3
BenchmarkMetricGemini 3.1 Pro PreviewMiniMax M2.1
OpenHands IndexreportedAverage% resolved 60.6%41.2%
OpenHands IndexreportedFront end (SWE-Bench Multimodal)% resolved 44.1%16.2%
OpenHands IndexreportedGreenfield (Commit0)% resolved 25.0%18.8%
OpenHands IndexreportedInformation gathering (GAIA)% resolved 81.8%40.6%
OpenHands IndexreportedIssue resolution (SWE-Bench)% resolved 76.8%68.8%
OpenHands IndexreportedTesting (SWT-Bench)% resolved 75.1%61.4%
UGI LeaderboardreportedRequested-length error% off the requested word count 19.0%31.0%
UGI LeaderboardreportedStyle adherencescore from 0 to 1 0.340.41
UGI LeaderboardreportedWriting scorescore out of 100 72.241.6
Vectara Hallucination LeaderboardreportedAnswer rate% of documents 99.4%98.5%
Vectara Hallucination LeaderboardreportedHallucination rate% of summaries 10.4%11.8%

Bold green marks the better value on that metric. Where a source reports ranges that overlap, the difference may not be meaningful; see the benchmark page for ranges.