Skip to content

Models / GPT-6 Astra

OpenAI

GPT-6 Astra

48 published results from 6 sources. Each card shows where the number comes from and what it does not measure. Results are never combined into one score.

Provider: OpenAI
Sources: 6
Our benchmarks: 3
Price: Not yet published

Measured by Spring Prompt

Measured by Spring Prompt · BulletBench

839

Ladder Elo · rank 1 of 16

Unit: ladder Elo, higher is better
Range: 595 to 1,072
Sample: 8 games
Configuration: GPT-6 Astra, provider default reasoning
Measured: 29 Sep 2026
Not shown: Not a business skill: chess against an engine on a real clock, used here as a speed-under-pressure signal.

Measured by Spring Prompt · BulletBench

5.6 s

Median move time · rank 6 of 16

Unit: milliseconds, lower is better
Configuration: GPT-6 Astra, provider default reasoning
Measured: 29 Sep 2026
Not shown: Not general response speed: replies are one short move.

Measured by Spring Prompt · CatalogBench

98.8%

Content quality · rank 1 of 18

Unit: % of checks, higher is better
Configuration: GPT-6 Astra, provider default reasoning
Measured: 30 Sep 2026
Not shown: Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.

Measured by Spring Prompt · CatalogBench

0.0%

Failed outputs · rank 1 of 18

Unit: % of products, lower is better
Configuration: GPT-6 Astra, provider default reasoning
Measured: 30 Sep 2026
Not shown: Not a provider outage: provider errors are retried before a product counts as failed.

Measured by Spring Prompt · CatalogBench

70.2%

Publish-ready listings · rank 1 of 18

Unit: % of products, higher is better
Configuration: GPT-6 Astra, provider default reasoning
Measured: 30 Sep 2026
Not shown: Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.

Measured by Spring Prompt · CatalogBench

66.1%

Reliably publish-ready · rank 1 of 18

Unit: % of products, higher is better
Configuration: GPT-6 Astra, provider default reasoning
Measured: 30 Sep 2026
Not shown: Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.

Measured by Spring Prompt · CatalogBench

0.18

Unsupported claims · rank 2 of 18

Unit: claims per product, lower is better
Configuration: GPT-6 Astra, provider default reasoning
Measured: 30 Sep 2026
Not shown: Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.

Measured by Spring Prompt · CatalogBench

100.0%

Channel compliance · rank 1 of 18

Unit: % of products, higher is better
Configuration: GPT-6 Astra, provider default reasoning
Measured: 30 Sep 2026
Not shown: Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.

Measured by Spring Prompt · CatalogBench

100.0%

Conflicts caught · rank 1 of 18

Unit: % of conflicts, higher is better
Configuration: GPT-6 Astra, provider default reasoning
Measured: 30 Sep 2026
Not shown: Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.

Measured by Spring Prompt · CatalogBench

98.3%

Content quality · rank 2 of 18

Unit: % of checks, higher is better
Configuration: GPT-6 Astra, provider default reasoning
Measured: 30 Sep 2026
Not shown: Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.

Measured by Spring Prompt · CatalogBench

$0.0371

Cost per product · rank 15 of 18

Unit: US dollars, lower is better
Configuration: GPT-6 Astra, provider default reasoning
Measured: 30 Sep 2026
Not shown: Not your cost: prices are those charged through OpenRouter on the run date.

Measured by Spring Prompt · CatalogBench

98.1%

Decision accuracy · rank 2 of 18

Unit: % of decisions, higher is better
Configuration: GPT-6 Astra, provider default reasoning
Measured: 30 Sep 2026
Not shown: Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.

Measured by Spring Prompt · CatalogBench

0.0%

Failed outputs · rank 1 of 18

Unit: % of products, lower is better
Configuration: GPT-6 Astra, provider default reasoning
Measured: 30 Sep 2026
Not shown: Not a provider outage: provider errors are retried before a product counts as failed.

Measured by Spring Prompt · CatalogBench

94.2%

Field accuracy · rank 6 of 18

Unit: % of missing fields, higher is better
Configuration: GPT-6 Astra, provider default reasoning
Measured: 30 Sep 2026
Not shown: Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.

Measured by Spring Prompt · CatalogBench

1.9%

Invented values · rank 12 of 18

Unit: % of filled values, lower is better
Configuration: GPT-6 Astra, provider default reasoning
Measured: 30 Sep 2026
Not shown: Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.

Measured by Spring Prompt · CatalogBench

74.4%

Publish-ready listings · rank 2 of 18

Unit: % of products, higher is better
Configuration: GPT-6 Astra, provider default reasoning
Measured: 30 Sep 2026
Not shown: Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.

Measured by Spring Prompt · CatalogBench

71.4%

Reliably publish-ready · rank 1 of 18

Unit: % of products, higher is better
Configuration: GPT-6 Astra, provider default reasoning
Measured: 30 Sep 2026
Not shown: Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.

Measured by Spring Prompt · CatalogBench

0.14

Unsupported claims · rank 2 of 18

Unit: claims per product, lower is better
Configuration: GPT-6 Astra, provider default reasoning
Measured: 30 Sep 2026
Not shown: Not your catalogue: invented products with generated images, so a model's result on your own feed can differ.

Measured by Spring Prompt · ROASBench

$1.23

Cost of a run · rank 16 of 17

Unit: US dollars, lower is better
Configuration: GPT-6 Astra, provider default reasoning
Measured: 29 Sep 2026
Not shown: Not your cost: prices are those charged through OpenRouter on the run date.

Measured by Spring Prompt · ROASBench

0

Months over budget · rank 1 of 17

Unit: months of 12, lower is better
Configuration: GPT-6 Astra, provider default reasoning
Measured: 29 Sep 2026
Not shown: Not real ad performance: the market is a deterministic simulation of one invented skincare brand.

Measured by Spring Prompt · ROASBench

56.6

Overall score · rank 1 of 17

Unit: score out of 100, higher is better
Configuration: GPT-6 Astra, provider default reasoning
Measured: 29 Sep 2026
Not shown: Not real ad performance: the market is a deterministic simulation of one invented skincare brand.

Measured by Spring Prompt · ROASBench

£0.67

Return on ad spend · rank 3 of 17

Unit: profit per £1 spent, higher is better
Configuration: GPT-6 Astra, provider default reasoning
Measured: 29 Sep 2026
Not shown: Not real ad performance: the market is a deterministic simulation of one invented skincare brand.

Reported by others

Reported by Arena (formerly LMArena)

0.13

Confirmed task success · rank 1 of 46

Unit: IPS effect estimate, higher is better
Range: 0.09 to 0.16
Sample: 5966 observations
Configuration: GPT-6 Astra
Measured: 28 Sep 2026
Not shown: Not a success rate: the estimated effect of choosing this model as the agent's orchestrator, against an even mix of the models tested, inside Arena's own harness.

Reported by Arena (formerly LMArena)

0.34

Praise over complaint · rank 1 of 46

Unit: IPS effect estimate, higher is better
Range: 0.25 to 0.43
Sample: 1537 observations
Configuration: GPT-6 Astra
Measured: 28 Sep 2026
Not shown: Not a success rate: the estimated effect of choosing this model as the agent's orchestrator, against an even mix of the models tested, inside Arena's own harness.

Reported by Arena (formerly LMArena)

-0.01

Steerability · rank 11 of 46

Unit: IPS effect estimate, higher is better
Range: -0.06 to 0.04
Sample: 3817 observations
Configuration: GPT-6 Astra
Measured: 28 Sep 2026
Not shown: Not a success rate: the estimated effect of choosing this model as the agent's orchestrator, against an even mix of the models tested, inside Arena's own harness.

Reported by Arena (formerly LMArena)

0.00

Tool grounding · rank 1 of 46

Unit: IPS effect estimate, higher is better
Range: 0.00 to 0.00
Sample: 828887 observations
Configuration: GPT-6 Astra
Measured: 28 Sep 2026
Not shown: Not a success rate: the estimated effect of choosing this model as the agent's orchestrator, against an even mix of the models tested, inside Arena's own harness.

Reported by Arena (formerly LMArena)

1,473

Overall · rank 5 of 44

Unit: Arena rating, higher is better
Range: 1,458 to 1,487
Sample: 1621 votes
Configuration: GPT-6 Astra (max)
Measured: 13 Sep 2026
Not shown: Not accuracy or correctness: it ranks which answer voters preferred, with answer length and formatting controlled for.

Reported by Arena (formerly LMArena)

1,465

Overall · rank 22 of 177

Unit: Arena rating, higher is better
Range: 1,458 to 1,471
Sample: 6910 votes
Configuration: GPT-6 Astra (max)
Measured: 25 Sep 2026
Not shown: Not an error rate: claims that cannot be checked on the web are skipped, and preference still carries most of the weight.

Reported by Arena (formerly LMArena)

1,483

Business, management and finance · rank 2 of 402

Unit: Arena rating, higher is better
Range: 1,466 to 1,499
Sample: 1343 votes
Configuration: GPT-6 Astra (max)
Measured: 25 Sep 2026
Not shown: Not accuracy or correctness: it ranks which answer voters preferred, with answer length and formatting controlled for.

Reported by Arena (formerly LMArena)

1,453

Creative writing · rank 12 of 407

Unit: Arena rating, higher is better
Range: 1,437 to 1,470
Sample: 1484 votes
Configuration: GPT-6 Astra (max)
Measured: 25 Sep 2026
Not shown: Not accuracy or correctness: it ranks which answer voters preferred, with answer length and formatting controlled for.

Reported by Arena (formerly LMArena)

1,510

Expert prompts · rank 4 of 359

Unit: Arena rating, higher is better
Range: 1,488 to 1,532
Sample: 729 votes
Configuration: GPT-6 Astra (max)
Measured: 25 Sep 2026
Not shown: Not accuracy or correctness: it ranks which answer voters preferred, with answer length and formatting controlled for.

Reported by Arena (formerly LMArena)

1,473

Instruction following · rank 9 of 409

Unit: Arena rating, higher is better
Range: 1,461 to 1,486
Sample: 2284 votes
Configuration: GPT-6 Astra (max)
Measured: 25 Sep 2026
Not shown: Not accuracy or correctness: it ranks which answer voters preferred, with answer length and formatting controlled for.

Reported by Arena (formerly LMArena)

1,478

Overall · rank 13 of 409

Unit: Arena rating, higher is better
Range: 1,470 to 1,485
Sample: 7185 votes
Configuration: GPT-6 Astra (max)
Measured: 25 Sep 2026
Not shown: Not accuracy or correctness: it ranks which answer voters preferred, with answer length and formatting controlled for.

Reported by Arena (formerly LMArena)

1,469

Writing, literature and language · rank 8 of 408

Unit: Arena rating, higher is better
Range: 1,455 to 1,483
Sample: 1929 votes
Configuration: GPT-6 Astra (max)
Measured: 25 Sep 2026
Not shown: Not accuracy or correctness: it ranks which answer voters preferred, with answer length and formatting controlled for.

Reported by UGI Leaderboard

0.0%

Requested-length error · rank 1 of 370

Unit: % off the requested word count, lower is better
Configuration: gpt-6-astra
Measured: 5 Sep 2026
Not shown: Not other format limits such as character counts or bullet counts.

Reported by UGI Leaderboard

1.0%

Requested-length error · rank 3 of 370

Unit: % off the requested word count, lower is better
Configuration: gpt-6-astra
Measured: 5 Sep 2026
Not shown: Not other format limits such as character counts or bullet counts.

Reported by UGI Leaderboard

1.0%

Requested-length error · rank 3 of 370

Unit: % off the requested word count, lower is better
Configuration: gpt-6-astra
Measured: 5 Sep 2026
Not shown: Not other format limits such as character counts or bullet counts.

Reported by UGI Leaderboard

0.0%

Requested-length error · rank 1 of 370

Unit: % off the requested word count, lower is better
Configuration: gpt-6-astra
Measured: 5 Sep 2026
Not shown: Not other format limits such as character counts or bullet counts.

Reported by UGI Leaderboard

0.36

Style adherence · rank 124 of 370

Unit: score from 0 to 1, higher is better
Configuration: gpt-6-astra
Measured: 5 Sep 2026
Not shown: Not brand voice on your own examples: UGI's prompts are private and lean towards creative writing.

Reported by UGI Leaderboard

0.37

Style adherence · rank 104 of 370

Unit: score from 0 to 1, higher is better
Configuration: gpt-6-astra
Measured: 5 Sep 2026
Not shown: Not brand voice on your own examples: UGI's prompts are private and lean towards creative writing.

Reported by UGI Leaderboard

0.38

Style adherence · rank 71 of 370

Unit: score from 0 to 1, higher is better
Configuration: gpt-6-astra
Measured: 5 Sep 2026
Not shown: Not brand voice on your own examples: UGI's prompts are private and lean towards creative writing.

Reported by UGI Leaderboard

0.38

Style adherence · rank 71 of 370

Unit: score from 0 to 1, higher is better
Configuration: gpt-6-astra
Measured: 5 Sep 2026
Not shown: Not brand voice on your own examples: UGI's prompts are private and lean towards creative writing.

Reported by UGI Leaderboard

68.9

Writing score · rank 32 of 370

Unit: score out of 100, higher is better
Configuration: gpt-6-astra
Measured: 5 Sep 2026
Not shown: Not business copy quality: UGI's prompts are private and lean towards creative writing, and models that often refuse get no score.

Reported by UGI Leaderboard

65.1

Writing score · rank 64 of 370

Unit: score out of 100, higher is better
Configuration: gpt-6-astra
Measured: 5 Sep 2026
Not shown: Not business copy quality: UGI's prompts are private and lean towards creative writing, and models that often refuse get no score.

Reported by UGI Leaderboard

68.1

Writing score · rank 39 of 370

Unit: score out of 100, higher is better
Configuration: gpt-6-astra
Measured: 5 Sep 2026
Not shown: Not business copy quality: UGI's prompts are private and lean towards creative writing, and models that often refuse get no score.

Reported by UGI Leaderboard

68.0

Writing score · rank 40 of 370

Unit: score out of 100, higher is better
Configuration: gpt-6-astra
Measured: 5 Sep 2026
Not shown: Not business copy quality: UGI's prompts are private and lean towards creative writing, and models that often refuse get no score.

Reported by Vectara Hallucination Leaderboard

100.0%

Answer rate · rank 1 of 108

Unit: % of documents, higher is better
Configuration: GPT-6 Astra
Measured: 22 Sep 2026
Not shown: Not a quality score: a low rate usually means content filters were triggered, and hallucination rates are measured on answered documents only.

Reported by Vectara Hallucination Leaderboard

8.7%

Hallucination rate · rank 45 of 108

Unit: % of summaries, lower is better
Configuration: GPT-6 Astra
Measured: 22 Sep 2026
Not shown: Not errors in open questions or other tasks: only summarisation, judged by Vectara's own model (HHEM-2.3), not by people, on news-style documents rather than your data.

Compare GPT-6 Astra with