Models / ai21-jamba-large-1.7

AI21 Labs

ai21-jamba-large-1.7

5 published results from 2 sources. Each card shows where the number comes from and what it does not measure. Results are never combined into one score.

Provider
AI21 Labs
Sources
2
Our benchmarks
0
Price
Not yet published

Reported by others

Reported by UGI Leaderboard
20.0%
Requested-length error · rank 179 of 370
Unit
% off the requested word count, lower is better
Configuration
ai21-jamba-large-1.7
Measured
21 Sep 2025
Not shown
Not other format limits such as character counts or bullet counts.
Reported by UGI Leaderboard
0.36
Style adherence · rank 140 of 370
Unit
score from 0 to 1, higher is better
Configuration
ai21-jamba-large-1.7
Measured
21 Sep 2025
Not shown
Not brand voice on your own examples: UGI's prompts are private and lean towards creative writing.
Reported by UGI Leaderboard
38.0
Writing score · rank 227 of 370
Unit
score out of 100, higher is better
Configuration
ai21-jamba-large-1.7
Measured
21 Sep 2025
Not shown
Not business copy quality: UGI's prompts are private and lean towards creative writing, and models that often refuse get no score.
98.9%
Answer rate · rank 71 of 108
Unit
% of documents, higher is better
Configuration
ai21-jamba-large-1.7
Measured
22 Sep 2026
Not shown
Not a quality score: a low rate usually means content filters were triggered, and hallucination rates are measured on answered documents only.
9.7%
Hallucination rate · rank 57 of 108
Unit
% of summaries, lower is better
Configuration
ai21-jamba-large-1.7
Measured
22 Sep 2026
Not shown
Not errors in open questions or other tasks: only summarisation, judged by Vectara's own model (HHEM-2.3), not by people, on news-style documents rather than your data.

Compare ai21-jamba-large-1.7 with