Models / o3 Pro

OpenAI

o3 Pro

2 published results from 1 source. Each card shows where the number comes from and what it does not measure. The overall leaderboard combines them; here each stands alone.

Provider
OpenAI
Sources
1
Our benchmarks
0
Price per million tokens
$20.00 in · $80.00 out
OpenRouter list price, 1 Oct 2026 · 200,000-token context

Reported by others

100.0%
Answer rate · rank 1 of 108
Unit
% of documents, higher is better
Configuration
o3 Pro
Measured
22 Sep 2026
Not shown
Not a quality score: a low rate usually means content filters were triggered, and hallucination rates are measured on answered documents only.
23.3%
Hallucination rate · rank 106 of 108
Unit
% of summaries, lower is better
Configuration
o3 Pro
Measured
22 Sep 2026
Not shown
Not errors in open questions or other tasks: only summarisation, judged by Vectara's own model (HHEM-2.3), not by people, on news-style documents rather than your data.