Models / ai21-jamba-mini-1.7

AI21 Labs

ai21-jamba-mini-1.7

5 published results from 2 sources. Each card shows where the number comes from and what it does not measure. Results are never combined into one score.

Provider
AI21 Labs
Sources
2
Our benchmarks
0
Price
Not yet published

Reported by others

Reported by UGI Leaderboard
36.0%
Requested-length error · rank 281 of 370
Unit
% off the requested word count, lower is better
Configuration
ai21-jamba-mini-1.7
Measured
21 Sep 2025
Not shown
Not other format limits such as character counts or bullet counts.
Reported by UGI Leaderboard
0.36
Style adherence · rank 111 of 370
Unit
score from 0 to 1, higher is better
Configuration
ai21-jamba-mini-1.7
Measured
21 Sep 2025
Not shown
Not brand voice on your own examples: UGI's prompts are private and lean towards creative writing.
Reported by UGI Leaderboard
23.8
Writing score · rank 314 of 370
Unit
score out of 100, higher is better
Configuration
ai21-jamba-mini-1.7
Measured
21 Sep 2025
Not shown
Not business copy quality: UGI's prompts are private and lean towards creative writing, and models that often refuse get no score.
99.1%
Answer rate · rank 64 of 108
Unit
% of documents, higher is better
Configuration
ai21-jamba-mini-1.7
Measured
22 Sep 2026
Not shown
Not a quality score: a low rate usually means content filters were triggered, and hallucination rates are measured on answered documents only.
14.7%
Hallucination rate · rank 93 of 108
Unit
% of summaries, lower is better
Configuration
ai21-jamba-mini-1.7
Measured
22 Sep 2026
Not shown
Not errors in open questions or other tasks: only summarisation, judged by Vectara's own model (HHEM-2.3), not by people, on news-style documents rather than your data.

Compare ai21-jamba-mini-1.7 with