Models / GPT-5.6 Sol

OpenAI

GPT-5.6 Sol

32 published results from 4 sources. Each card shows where the number comes from and what it does not measure. Results are never combined into one score.

Provider
OpenAI
Sources
4
Our benchmarks
0
Price
Not yet published

Reported by others

0.03
Confirmed task success · rank 12 of 46
Unit
IPS effect estimate, higher is better
Range
0.01 to 0.06
Sample
26624 observations
Configuration
GPT-5.6 Sol
Measured
28 Sep 2026
Not shown
Not a success rate: the estimated effect of choosing this model as the agent's orchestrator, against an even mix of the models tested, inside Arena's own harness.
0.19
Praise over complaint · rank 3 of 46
Unit
IPS effect estimate, higher is better
Range
0.14 to 0.23
Sample
9148 observations
Configuration
GPT-5.6 Sol
Measured
28 Sep 2026
Not shown
Not a success rate: the estimated effect of choosing this model as the agent's orchestrator, against an even mix of the models tested, inside Arena's own harness.
0.07
Steerability · rank 4 of 46
Unit
IPS effect estimate, higher is better
Range
0.04 to 0.09
Sample
30733 observations
Configuration
GPT-5.6 Sol
Measured
28 Sep 2026
Not shown
Not a success rate: the estimated effect of choosing this model as the agent's orchestrator, against an even mix of the models tested, inside Arena's own harness.
0.00
Tool grounding · rank 1 of 46
Unit
IPS effect estimate, higher is better
Range
0.00 to 0.00
Sample
3736572 observations
Configuration
GPT-5.6 Sol
Measured
28 Sep 2026
Not shown
Not a success rate: the estimated effect of choosing this model as the agent's orchestrator, against an even mix of the models tested, inside Arena's own harness.
1,489
Overall · rank 1 of 44
Unit
Arena rating, higher is better
Range
1,480 to 1,498
Sample
4818 votes
Configuration
GPT-5.6 Sol (xhigh)
Measured
13 Sep 2026
Not shown
Not accuracy or correctness: it ranks which answer voters preferred, with answer length and formatting controlled for.
1,256
Overall · rank 1 of 34
Unit
Arena rating, higher is better
Range
1,248 to 1,263
Sample
29663 votes
Configuration
GPT-5.6 Sol (xhigh)
Measured
24 Aug 2026
Not shown
Not accuracy or correctness: it ranks which answer voters preferred, with answer length and formatting controlled for.
1,476
Overall · rank 9 of 177
Unit
Arena rating, higher is better
Range
1,472 to 1,479
Sample
33919 votes
Configuration
GPT-5.6 Sol (xhigh)
Measured
25 Sep 2026
Not shown
Not an error rate: claims that cannot be checked on the web are skipped, and preference still carries most of the weight.
1,485
Business, management and finance · rank 6 of 402
Unit
Arena rating, higher is better
Range
1,477 to 1,493
Sample
6528 votes
Configuration
GPT-5.6 Sol (xhigh)
Measured
25 Sep 2026
Not shown
Not accuracy or correctness: it ranks which answer voters preferred, with answer length and formatting controlled for.
1,470
Creative writing · rank 6 of 407
Unit
Arena rating, higher is better
Range
1,462 to 1,478
Sample
6868 votes
Configuration
GPT-5.6 Sol (xhigh)
Measured
25 Sep 2026
Not shown
Not accuracy or correctness: it ranks which answer voters preferred, with answer length and formatting controlled for.
1,534
Expert prompts · rank 1 of 359
Unit
Arena rating, higher is better
Range
1,524 to 1,544
Sample
3890 votes
Configuration
GPT-5.6 Sol (xhigh)
Measured
25 Sep 2026
Not shown
Not accuracy or correctness: it ranks which answer voters preferred, with answer length and formatting controlled for.
1,489
Instruction following · rank 5 of 409
Unit
Arena rating, higher is better
Range
1,483 to 1,496
Sample
12137 votes
Configuration
GPT-5.6 Sol (xhigh)
Measured
25 Sep 2026
Not shown
Not accuracy or correctness: it ranks which answer voters preferred, with answer length and formatting controlled for.
1,483
Overall · rank 8 of 409
Unit
Arena rating, higher is better
Range
1,479 to 1,488
Sample
34258 votes
Configuration
GPT-5.6 Sol (xhigh)
Measured
25 Sep 2026
Not shown
Not accuracy or correctness: it ranks which answer voters preferred, with answer length and formatting controlled for.
1,483
Writing, literature and language · rank 5 of 408
Unit
Arena rating, higher is better
Range
1,475 to 1,490
Sample
9085 votes
Configuration
GPT-5.6 Sol (xhigh)
Measured
25 Sep 2026
Not shown
Not accuracy or correctness: it ranks which answer voters preferred, with answer length and formatting controlled for.
Reported by tau2-bench
27.8%
Consistency (pass^4) · rank 6 of 21
Unit
% of tasks, higher is better
Configuration
gpt-5.6-sol
Measured
22 Jul 2026
Not shown
Not your policies or customers: the tasks and policies are tau2's own, and the customer is simulated by gpt-5.2.
Reported by tau2-bench
46.9%
Task success (pass^1) · rank 4 of 21
Unit
% of tasks, higher is better
Configuration
gpt-5.6-sol
Measured
22 Jul 2026
Not shown
Not your policies or customers: the tasks and policies are tau2's own, and the customer is simulated by gpt-5.2.
Reported by UGI Leaderboard
4.0%
Requested-length error · rank 28 of 370
Unit
% off the requested word count, lower is better
Configuration
gpt-5.6-sol
Measured
9 Jul 2026
Not shown
Not other format limits such as character counts or bullet counts.
Reported by UGI Leaderboard
10.0%
Requested-length error · rank 81 of 370
Unit
% off the requested word count, lower is better
Configuration
gpt-5.6-sol
Measured
9 Jul 2026
Not shown
Not other format limits such as character counts or bullet counts.
Reported by UGI Leaderboard
7.0%
Requested-length error · rank 48 of 370
Unit
% off the requested word count, lower is better
Configuration
gpt-5.6-sol
Measured
9 Jul 2026
Not shown
Not other format limits such as character counts or bullet counts.
Reported by UGI Leaderboard
16.0%
Requested-length error · rank 127 of 370
Unit
% off the requested word count, lower is better
Configuration
gpt-5.6-sol
Measured
9 Jul 2026
Not shown
Not other format limits such as character counts or bullet counts.
Reported by UGI Leaderboard
1.0%
Requested-length error · rank 3 of 370
Unit
% off the requested word count, lower is better
Configuration
GPT-5.6 Sol (xhigh)
Measured
9 Jul 2026
Not shown
Not other format limits such as character counts or bullet counts.
Reported by UGI Leaderboard
0.35
Style adherence · rank 153 of 370
Unit
score from 0 to 1, higher is better
Configuration
gpt-5.6-sol
Measured
9 Jul 2026
Not shown
Not brand voice on your own examples: UGI's prompts are private and lean towards creative writing.
Reported by UGI Leaderboard
0.36
Style adherence · rank 117 of 370
Unit
score from 0 to 1, higher is better
Configuration
gpt-5.6-sol
Measured
9 Jul 2026
Not shown
Not brand voice on your own examples: UGI's prompts are private and lean towards creative writing.
Reported by UGI Leaderboard
0.35
Style adherence · rank 166 of 370
Unit
score from 0 to 1, higher is better
Configuration
gpt-5.6-sol
Measured
9 Jul 2026
Not shown
Not brand voice on your own examples: UGI's prompts are private and lean towards creative writing.
Reported by UGI Leaderboard
0.35
Style adherence · rank 153 of 370
Unit
score from 0 to 1, higher is better
Configuration
gpt-5.6-sol
Measured
9 Jul 2026
Not shown
Not brand voice on your own examples: UGI's prompts are private and lean towards creative writing.
Reported by UGI Leaderboard
0.37
Style adherence · rank 88 of 370
Unit
score from 0 to 1, higher is better
Configuration
GPT-5.6 Sol (xhigh)
Measured
9 Jul 2026
Not shown
Not brand voice on your own examples: UGI's prompts are private and lean towards creative writing.
Reported by UGI Leaderboard
65.3
Writing score · rank 62 of 370
Unit
score out of 100, higher is better
Configuration
gpt-5.6-sol
Measured
9 Jul 2026
Not shown
Not business copy quality: UGI's prompts are private and lean towards creative writing, and models that often refuse get no score.
Reported by UGI Leaderboard
63.0
Writing score · rank 84 of 370
Unit
score out of 100, higher is better
Configuration
gpt-5.6-sol
Measured
9 Jul 2026
Not shown
Not business copy quality: UGI's prompts are private and lean towards creative writing, and models that often refuse get no score.
Reported by UGI Leaderboard
65.4
Writing score · rank 61 of 370
Unit
score out of 100, higher is better
Configuration
gpt-5.6-sol
Measured
9 Jul 2026
Not shown
Not business copy quality: UGI's prompts are private and lean towards creative writing, and models that often refuse get no score.
Reported by UGI Leaderboard
59.9
Writing score · rank 103 of 370
Unit
score out of 100, higher is better
Configuration
gpt-5.6-sol
Measured
9 Jul 2026
Not shown
Not business copy quality: UGI's prompts are private and lean towards creative writing, and models that often refuse get no score.
Reported by UGI Leaderboard
63.2
Writing score · rank 82 of 370
Unit
score out of 100, higher is better
Configuration
GPT-5.6 Sol (xhigh)
Measured
9 Jul 2026
Not shown
Not business copy quality: UGI's prompts are private and lean towards creative writing, and models that often refuse get no score.
99.1%
Answer rate · rank 64 of 108
Unit
% of documents, higher is better
Configuration
GPT-5.6 Sol
Measured
22 Sep 2026
Not shown
Not a quality score: a low rate usually means content filters were triggered, and hallucination rates are measured on answered documents only.
12.4%
Hallucination rate · rank 85 of 108
Unit
% of summaries, lower is better
Configuration
GPT-5.6 Sol
Measured
22 Sep 2026
Not shown
Not errors in open questions or other tasks: only summarisation, judged by Vectara's own model (HHEM-2.3), not by people, on news-style documents rather than your data.

Compare GPT-5.6 Sol with