AI model benchmarks
What each benchmark measures, who measured it, and how today's models do. For one score across all of them, see the overall leaderboard; for launches and pace, models over time.
Measured by Spring Prompt
What each of our own benchmarks tests, how it is scored and what it leaves out: our benchmarks, explained.
- Speed under time pressure BulletBench When thinking time comes off the clock, which models are quick enough to still make good decisions? Leader: Gemini 3.5 Flash-Lite 89245 modelsLast updated 19 Nov 2026
- Product listings CatalogBench Can a model turn a product feed and photos into a listing that is ready to publish, without making things up? Leader: Gemini 4 Neon 78.6%35 modelsLast updated 19 Nov 2026
- Slide decks DeckBench Can a model turn an analysis into a deck you could present without fixing it? Leader: Qwen4-Max 1,56336 modelsLast updated 19 Nov 2026
- Ad budgets ROASBench Given a year of ad spend decisions, which models grow revenue and which ones burn the budget? Leader: Claude Fable 5.2 61.336 modelsLast updated 18 Nov 2026
- Survey research SurveyBench Can a model plan a user survey and read its results without being misled? Leader: Claude Fable 5.2 1,67027 modelsLast updated 19 Nov 2026
One number from these benchmarks: the Spring Prompt Score, each model's average percentile across them, with equal weights.
Which model for the job
From our own benchmarks: the top result, and the cheapest model that gets at least 70% of its score. Costs are at the run date's prices.
- Product listings (CatalogBench) Best: Gemini 4 Neon, 78.6% at $652.78 per 10,000 products. Best value: GPT-6 Luna, 55.4% at $4.77 per 10,000 products.
- Slide decks (DeckBench) Best: Qwen4-Max, 1,563 at $0.18 a deck. Best value: GPT-6 Luna, 1,252 at $0.0087 a deck.
- Survey research (SurveyBench) Best: Claude Fable 5.2, 1,670 at $1.51 a task. Best value: Claude Haiku 5.5, 1,233 at $0.0185 a task.
- Ad budgets (ROASBench) Best: Claude Fable 5.2, 61.3 at $1.76 a simulated year. Best value: GPT-6 Luna, 53.4 at $0.0142 a simulated year.
- Speed under time pressure (BulletBench) Best: Gemini 3.5 Flash-Lite, 892 at $0.0070 a game. Best value: Gemini Decision 1, 755 at $0.0018 a game.
Quick answers
Which benchmarks does Spring Prompt run itself?
BulletBench, CatalogBench, DeckBench, ROASBench and SurveyBench. We design and run these on business work, such as product listings, decks and ad budgets, and publish every model's output with the scores.
Where do the other results come from?
13 leaderboards run by other teams, including APEX-Agents, Arena (formerly LMArena) and Artificial Analysis. Each page links to the original and shows the dates of its results.
Which AI benchmark should I look at for my task?
Pick the one closest to the work: for customer support agents, tau2-bench and Microsoft STATE-Bench; for agents doing office and professional work, APEX-Agents and Remote Labor Index; for coding agents, OpenHands Index; for tool and function calling, Berkeley Function Calling Leaderboard (BFCL) V4; for made-up facts in summaries, Vectara Hallucination Leaderboard. For one score across all of them, see the overall leaderboard.