This website uses cookies for authentication, support chat, and analytics. Only authentication cookies are turned on by default.
Animate this data
Bar chart race of gemma-7b, gemini-4-argon_high, gpt-6-astra_max and 7 more, by GPQA Diamond.
Create it free
Takes a free account
gemma-7b
Adversarial Nli
49 %
Bbh
55 %
Bool Q
83 %
Gsm8k
46 %
Hella Swag
82 %
Mmlu
66 %
Open Book Qa
79 %
Piqa
81 %
Trivia Qa
72 %
Wino Grande
79 %
Training Compute
307,000,000,000.00T FLOP
gemma-7b benchmark results.