Skip to content

Models / GPT-6 Sol

OpenAI

GPT-6 Sol

35 published results from 5 sources. Each card shows where the number comes from and what it does not measure. Results are never combined into one score.

Provider: OpenAI
Sources: 5
Our benchmarks: 3
Price: Not yet published

Measured by Spring Prompt

Measured by Spring Prompt · BulletBench

0

Ladder Elo · rank 12 of 16

Unit: ladder Elo, higher is better
Configuration: GPT-6 Sol, provider default reasoning
Measured: 29 Sep 2026
Not shown: Not a business skill: chess against an engine on a real clock, used here as a speed-under-pressure signal.

Measured by Spring Prompt · BulletBench

8.2 s

Median move time · rank 14 of 16

Unit: milliseconds, lower is better
Configuration: GPT-6 Sol, provider default reasoning
Measured: 29 Sep 2026
Not shown: Not general response speed: replies are one short move.

Measured by Spring Prompt · CatalogBench

97.9%

Content quality · rank 3 of 18

Unit: % of checks, higher is better
Configuration: GPT-6 Sol, provider default reasoning
Measured: 30 Sep 2026
Not shown: Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.

Measured by Spring Prompt · CatalogBench

0.0%

Failed outputs · rank 1 of 18

Unit: % of products, lower is better
Configuration: GPT-6 Sol, provider default reasoning
Measured: 30 Sep 2026
Not shown: Not a provider outage: provider errors are retried before a product counts as failed.

Measured by Spring Prompt · CatalogBench

67.9%

Publish-ready listings · rank 3 of 18

Unit: % of products, higher is better
Configuration: GPT-6 Sol, provider default reasoning
Measured: 30 Sep 2026
Not shown: Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.

Measured by Spring Prompt · CatalogBench

55.4%

Reliably publish-ready · rank 3 of 18

Unit: % of products, higher is better
Configuration: GPT-6 Sol, provider default reasoning
Measured: 30 Sep 2026
Not shown: Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.

Measured by Spring Prompt · CatalogBench

0.36

Unsupported claims · rank 3 of 18

Unit: claims per product, lower is better
Configuration: GPT-6 Sol, provider default reasoning
Measured: 30 Sep 2026
Not shown: Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.

Measured by Spring Prompt · CatalogBench

100.0%

Channel compliance · rank 1 of 18

Unit: % of products, higher is better
Configuration: GPT-6 Sol, provider default reasoning
Measured: 30 Sep 2026
Not shown: Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.

Measured by Spring Prompt · CatalogBench

100.0%

Conflicts caught · rank 1 of 18

Unit: % of conflicts, higher is better
Configuration: GPT-6 Sol, provider default reasoning
Measured: 30 Sep 2026
Not shown: Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.

Measured by Spring Prompt · CatalogBench

97.7%

Content quality · rank 3 of 18

Unit: % of checks, higher is better
Configuration: GPT-6 Sol, provider default reasoning
Measured: 30 Sep 2026
Not shown: Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.

Measured by Spring Prompt · CatalogBench

$0.0085

Cost per product · rank 8 of 18

Unit: US dollars, lower is better
Configuration: GPT-6 Sol, provider default reasoning
Measured: 30 Sep 2026
Not shown: Not your cost: prices are those charged through OpenRouter on the run date.

Measured by Spring Prompt · CatalogBench

97.5%

Decision accuracy · rank 3 of 18

Unit: % of decisions, higher is better
Configuration: GPT-6 Sol, provider default reasoning
Measured: 30 Sep 2026
Not shown: Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.

Measured by Spring Prompt · CatalogBench

0.0%

Failed outputs · rank 1 of 18

Unit: % of products, lower is better
Configuration: GPT-6 Sol, provider default reasoning
Measured: 30 Sep 2026
Not shown: Not a provider outage: provider errors are retried before a product counts as failed.

Measured by Spring Prompt · CatalogBench

93.7%

Field accuracy · rank 7 of 18

Unit: % of missing fields, higher is better
Configuration: GPT-6 Sol, provider default reasoning
Measured: 30 Sep 2026
Not shown: Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.

Measured by Spring Prompt · CatalogBench

1.0%

Invented values · rank 9 of 18

Unit: % of filled values, lower is better
Configuration: GPT-6 Sol, provider default reasoning
Measured: 30 Sep 2026
Not shown: Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.

Measured by Spring Prompt · CatalogBench

70.2%

Publish-ready listings · rank 3 of 18

Unit: % of products, higher is better
Configuration: GPT-6 Sol, provider default reasoning
Measured: 30 Sep 2026
Not shown: Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.

Measured by Spring Prompt · CatalogBench

60.7%

Reliably publish-ready · rank 3 of 18

Unit: % of products, higher is better
Configuration: GPT-6 Sol, provider default reasoning
Measured: 30 Sep 2026
Not shown: Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.

Measured by Spring Prompt · CatalogBench

0.24

Unsupported claims · rank 3 of 18

Unit: claims per product, lower is better
Configuration: GPT-6 Sol, provider default reasoning
Measured: 30 Sep 2026
Not shown: Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.

Measured by Spring Prompt · ROASBench

$0.24

Cost of a run · rank 9 of 17

Unit: US dollars, lower is better
Configuration: GPT-6 Sol, provider default reasoning
Measured: 29 Sep 2026
Not shown: Not your cost: prices are those charged through OpenRouter on the run date.

Measured by Spring Prompt · ROASBench

0

Months over budget · rank 1 of 17

Unit: months of 12, lower is better
Configuration: GPT-6 Sol, provider default reasoning
Measured: 29 Sep 2026
Not shown: Not real ad performance: the market is a deterministic simulation of one invented skincare brand.

Measured by Spring Prompt · ROASBench

54.1

Overall score · rank 2 of 17

Unit: score out of 100, higher is better
Configuration: GPT-6 Sol, provider default reasoning
Measured: 29 Sep 2026
Not shown: Not real ad performance: the market is a deterministic simulation of one invented skincare brand.

Measured by Spring Prompt · ROASBench

£0.65

Return on ad spend · rank 5 of 17

Unit: profit per £1 spent, higher is better
Configuration: GPT-6 Sol, provider default reasoning
Measured: 29 Sep 2026
Not shown: Not real ad performance: the market is a deterministic simulation of one invented skincare brand.

Reported by others

Reported by Arena (formerly LMArena)

0.11

Confirmed task success · rank 1 of 46

Unit: IPS effect estimate, higher is better
Range: 0.07 to 0.15
Sample: 2988 observations
Configuration: GPT-6 Sol
Measured: 28 Sep 2026
Not shown: Not a success rate: the estimated effect of choosing this model as the agent's orchestrator, against an even mix of the models tested, inside Arena's own harness.

Reported by Arena (formerly LMArena)

0.11

Praise over complaint · rank 3 of 46

Unit: IPS effect estimate, higher is better
Range: 0.02 to 0.19
Sample: 857 observations
Configuration: GPT-6 Sol
Measured: 28 Sep 2026
Not shown: Not a success rate: the estimated effect of choosing this model as the agent's orchestrator, against an even mix of the models tested, inside Arena's own harness.

Reported by Arena (formerly LMArena)

0.15

Steerability · rank 1 of 46

Unit: IPS effect estimate, higher is better
Range: 0.10 to 0.19
Sample: 2749 observations
Configuration: GPT-6 Sol
Measured: 28 Sep 2026
Not shown: Not a success rate: the estimated effect of choosing this model as the agent's orchestrator, against an even mix of the models tested, inside Arena's own harness.

Reported by Arena (formerly LMArena)

0.00

Tool grounding · rank 1 of 46

Unit: IPS effect estimate, higher is better
Range: 0.00 to 0.00
Sample: 936105 observations
Configuration: GPT-6 Sol
Measured: 28 Sep 2026
Not shown: Not a success rate: the estimated effect of choosing this model as the agent's orchestrator, against an even mix of the models tested, inside Arena's own harness.

Reported by Arena (formerly LMArena)

1,424

Overall · rank 95 of 177

Unit: Arena rating, higher is better
Range: 1,416 to 1,432
Sample: 4379 votes
Configuration: GPT-6 Sol (max)
Measured: 25 Sep 2026
Not shown: Not an error rate: claims that cannot be checked on the web are skipped, and preference still carries most of the weight.

Reported by Arena (formerly LMArena)

1,465

Business, management and finance · rank 9 of 402

Unit: Arena rating, higher is better
Range: 1,445 to 1,484
Sample: 945 votes
Configuration: GPT-6 Sol (max)
Measured: 25 Sep 2026
Not shown: Not accuracy or correctness: it ranks which answer voters preferred, with answer length and formatting controlled for.

Reported by Arena (formerly LMArena)

1,451

Creative writing · rank 11 of 407

Unit: Arena rating, higher is better
Range: 1,431 to 1,472
Sample: 908 votes
Configuration: GPT-6 Sol (max)
Measured: 25 Sep 2026
Not shown: Not accuracy or correctness: it ranks which answer voters preferred, with answer length and formatting controlled for.

Reported by Arena (formerly LMArena)

1,507

Expert prompts · rank 4 of 359

Unit: Arena rating, higher is better
Range: 1,482 to 1,531
Sample: 533 votes
Configuration: GPT-6 Sol (max)
Measured: 25 Sep 2026
Not shown: Not accuracy or correctness: it ranks which answer voters preferred, with answer length and formatting controlled for.

Reported by Arena (formerly LMArena)

1,447

Instruction following · rank 33 of 409

Unit: Arena rating, higher is better
Range: 1,432 to 1,461
Sample: 1588 votes
Configuration: GPT-6 Sol (max)
Measured: 25 Sep 2026
Not shown: Not accuracy or correctness: it ranks which answer voters preferred, with answer length and formatting controlled for.

Reported by Arena (formerly LMArena)

1,457

Overall · rank 44 of 409

Unit: Arena rating, higher is better
Range: 1,449 to 1,466
Sample: 4773 votes
Configuration: GPT-6 Sol (max)
Measured: 25 Sep 2026
Not shown: Not accuracy or correctness: it ranks which answer voters preferred, with answer length and formatting controlled for.

Reported by Arena (formerly LMArena)

1,440

Writing, literature and language · rank 28 of 408

Unit: Arena rating, higher is better
Range: 1,423 to 1,458
Sample: 1225 votes
Configuration: GPT-6 Sol (max)
Measured: 25 Sep 2026
Not shown: Not accuracy or correctness: it ranks which answer voters preferred, with answer length and formatting controlled for.

Reported by Vectara Hallucination Leaderboard

100.0%

Answer rate · rank 1 of 108

Unit: % of documents, higher is better
Configuration: GPT-6 Sol
Measured: 22 Sep 2026
Not shown: Not a quality score: a low rate usually means content filters were triggered, and hallucination rates are measured on answered documents only.

Reported by Vectara Hallucination Leaderboard

6.5%

Hallucination rate · rank 29 of 108

Unit: % of summaries, lower is better
Configuration: GPT-6 Sol
Measured: 22 Sep 2026
Not shown: Not errors in open questions or other tasks: only summarisation, judged by Vectara's own model (HHEM-2.3), not by people, on news-style documents rather than your data.

Compare GPT-6 Sol with