Compare / GPT-5.4 vs GPT-5.5

GPT-5.4 vs GPT-5.5

32 results from 6 sources that measured both models. Each row is in the source's own units; there is no overall winner.

GPT-5.4
OpenAI · profile
GPT-5.5
OpenAI · profile
Results compared
32
Shared sources
6
BenchmarkMetricGPT-5.4GPT-5.5
Arena (formerly LMArena)reportedConfirmed task successIPS effect estimate -0.04-0.03
Arena (formerly LMArena)reportedPraise over complaintIPS effect estimate -0.010.08
Arena (formerly LMArena)reportedSteerabilityIPS effect estimate 0.020.07
Arena (formerly LMArena)reportedTool groundingIPS effect estimate 0.000.00
Arena (formerly LMArena)reportedOverallArena rating 1,4701,483
Arena (formerly LMArena)reportedOverallArena rating 1,1951,224
Arena (formerly LMArena)reportedOverallArena rating 1,4851,486
Arena (formerly LMArena)reportedBusiness, management and financeArena rating 1,4821,489
Arena (formerly LMArena)reportedCreative writingArena rating 1,4431,452
Arena (formerly LMArena)reportedExpert promptsArena rating 1,5151,513
Arena (formerly LMArena)reportedInstruction followingArena rating 1,4711,478
Arena (formerly LMArena)reportedOverallArena rating 1,4751,481
Arena (formerly LMArena)reportedWriting, literature and languageArena rating 1,4651,470
Microsoft STATE-BenchreportedConsistency (pass^5)% of tasks 41.8%44.2%
Microsoft STATE-BenchreportedCustomer support task success (pass@1)% of tasks 59.0%59.0%
Microsoft STATE-BenchreportedShopping assistant task success (pass@1)% of tasks 55.0%55.0%
Microsoft STATE-BenchreportedTask success (pass@1)% of tasks 58.6%58.9%
Microsoft STATE-BenchreportedTravel task success (pass@1)% of tasks 62.0%62.0%
Microsoft STATE-BenchreportedUser experiencescore from 1 to 5 3.673.62
OpenHands IndexreportedAverage% resolved 64.3%65.9%
OpenHands IndexreportedFront end (SWE-Bench Multimodal)% resolved 36.8%38.2%
OpenHands IndexreportedGreenfield (Commit0)% resolved 56.2%43.8%
OpenHands IndexreportedInformation gathering (GAIA)% resolved 82.4%86.1%
OpenHands IndexreportedIssue resolution (SWE-Bench)% resolved 75.6%78.2%
OpenHands IndexreportedTesting (SWT-Bench)% resolved 70.4%83.4%
tau2-benchreportedConsistency (pass^4)% of tasks 21.6%29.9%
tau2-benchreportedTask success (pass^1)% of tasks 39.4%44.6%
UGI LeaderboardreportedRequested-length error% off the requested word count 30.0%13.0%
UGI LeaderboardreportedStyle adherencescore from 0 to 1 0.400.41
UGI LeaderboardreportedWriting scorescore out of 100 68.869.7
Vectara Hallucination LeaderboardreportedAnswer rate% of documents 99.9%100.0%
Vectara Hallucination LeaderboardreportedHallucination rate% of summaries 7.0%9.3%

Bold green marks the better value on that metric. Where a source reports ranges that overlap, the difference may not be meaningful; see the benchmark page for ranges.