Models / Llama 3.1 405B Instruct (BF16)

Meta

Llama 3.1 405B Instruct (BF16)

Early evidence, 6 results from 1 source, on 1 use case. Llama 3.1 405B Instruct (BF16) trails most of the field on what it has been measured on; it is not on sale through OpenRouter, so it is here for reference.

Results 19 Nov 2026 · 6 results · 1 source

Price per million tokens
Not available through OpenRouter
Speed
Not measured
Intelligence Index
Not measured
Spring Prompt overall
Not ranked yet
needs our benchmarks and two groups of results
Developer
Meta, based in the US
Weights not published
Released
23 Jul 2024

How good is it, and for what?

Each use case ranks the available models its benchmarks measured. The bar shows its percentile in that field, best to the right. Open a row for the results behind it.

Product listingsTurning a sparse product feed and photos into listings that can go live Not measured
  • CatalogBench: has not measured this model.
Decks from an analysisTurning a finished analysis into a deck you could present as it is Not measured
  • DeckBench: has not measured this model.
User surveysPlanning a user survey and reading its results without being misled Not measured
  • SurveyBench: has not measured this model.
Marketing planningPlanning a year of ad spend without overspending Not measured
  • ROASBench: has not measured this model.
Agents and tool useMulti-step tasks with tools: support desks, coding agents, function calls Not measured
  • tau2-bench: has not measured this model.
  • Berkeley Function Calling Leaderboard (BFCL) V4: has not measured this model.
  • OpenHands Index: has not measured this model.
  • Microsoft STATE-Bench: has not measured this model.
  • Artificial Analysis: has not measured this model.
  • Vending-Bench 2: has not measured this model.
Professional workReal tasks from banking, consulting and law, business documents and freelance projects Not measured
  • APEX-Agents: has not measured this model.
  • GDP.pdf: has not measured this model.
  • Remote Labor Index: has not measured this model.
Reasoning and knowledgeHard questions across science, maths and general knowledge Not measured
  • Artificial Analysis: has not measured this model.
WritingWhat people prefer in blind comparisons, and judged writing quality 135th of 170 available
BenchmarkLlama 3.1 405B Instruct (BF16)Rank among availableBest available
Arena (formerly LMArena)Arena Text: overall · reported 1,335 126th of 154 Gemini 4 Argon 1,525
  • UGI Leaderboard: has not measured this model.
Sticking to the factsSummarising without inventing things, and factual answers Not measured
  • Vectara Hallucination Leaderboard: has not measured this model.
  • Arena (formerly LMArena): has not measured this model.
  • SimpleQA Verified (Epoch AI): has not measured this model.
Speed under pressureGood decisions against a real clock (fast chess) Not measured
  • BulletBench: has not measured this model.

Nearest alternatives

  • Meta's newer, at least as capable modelMuse Wonder$8.00 blended · Intelligence Index 52.4
  • The most capable open-weights modelMiMo-V2.6-Pro$0.54 blended · Intelligence Index 46.3

Against Llama 3.1 405B Instruct (BF16). "Similar intelligence" means within 4 points or better.

Against the alternatives

The models you would most likely weigh it against: the leaders of the groups above.

Scroll sideways to see every alternative.

Llama 3.1 405B Instruct (BF16)Claude Fable 5.2
leads overall
Muse Wonder
Meta's best other model
GPT-6.2 Astra
near the top overall
GPT-6.2 Sol
near the top overall
Price per million tokens – $16.00$8.00$16.00$4.00
Tokens a second – –153––
Intelligence Index – –52.4––
Spring Prompt overall – 88668684
Rank among available models, by use case
Product listings – 8th8th3rd1st
Decks from an analysis – 4th15th17th6th
User surveys – 1st3rd2nd7th
Marketing planning – 1st25th3rd9th
Agents and tool use – –11th––
Professional work – ––––
Reasoning and knowledge – –8th––
Writing 135th of 170 ––––
Sticking to the facts – ––––
Speed under pressure – 10th17th6th10th

Shaded figures are better than Llama 3.1 405B Instruct (BF16)'s. A dash means no result.

Where it has been measured

Compared with the models available today (it is not on sale itself), in the bottom quarter for writing.

Not timed: Artificial Analysis, our source for speed, has not tested it

Every result

6 published results from 1 source, each in the source's own units, with the configuration that produced it.

Arena (formerly LMArena) · reported by Arena (formerly LMArena) · 6 results
MeasureValueRankConfigurationDated
Arena Text: business, management and financeArena rating, higher is better 1,313
1,304–1,322
257 of 406 Llama 3.1 405B Instruct (BF16) 2 Oct 2026
Arena Text: creative writingArena rating, higher is better 1,301
1,294–1,309
235 of 411 Llama 3.1 405B Instruct (BF16) 2 Oct 2026
Arena Text: expert promptsArena rating, higher is better 1,312
1,299–1,325
248 of 363 Llama 3.1 405B Instruct (BF16) 2 Oct 2026
Arena Text: instruction followingArena rating, higher is better 1,314
1,309–1,320
246 of 413 Llama 3.1 405B Instruct (BF16) 2 Oct 2026
Arena Text: overallArena rating, higher is better 1,335
1,332–1,339
239 of 413 Llama 3.1 405B Instruct (BF16) 2 Oct 2026
Arena Text: writing, literature and languageArena rating, higher is better 1,312
1,306–1,318
235 of 412 Llama 3.1 405B Instruct (BF16) 2 Oct 2026

Not shown: Not accuracy or correctness: it ranks which answer voters preferred, with answer length and formatting controlled for.

Test your own prompt.

Benchmarks aren't your task. Run your prompt on the models you could use, with every answer checked and costed.