This website uses cookies for authentication, support chat, and analytics. Only authentication cookies are turned on by default.
Animate this data
Bar chart race of PaLM 540B, gpt-6-astra_max, gemini-3.8-flash_high and 7 more, by GPQA Diamond.
Create it free
Takes a free account
PaLM 540B
Bool Q
0.89 %
Gsm8k
0.57 %
Hella Swag
0.84 %
Lambada
0.78 %
Mmlu
0.69 %
Open Book Qa
0.68 %
Piqa
0.82 %
Trivia Qa
0.81 %
Wino Grande
0.85 %
Training Compute
2,527,200,000,000.00T FLOP
PaLM 540B benchmark results.