This website uses cookies for authentication, support chat, and analytics. Only authentication cookies are turned on by default.
Animate this data
Bar chart race of claude-3-5-sonnet-20241022, gpt-6-astra_max, gemini-3.8-flash_high and 7 more, by GPQA Diamond.
Create it free
Takes a free account
claude-3-5-sonnet-20241022
Aider Polyglot
0.52 %
BALROG
0.33 %
Cad Eval
0.48 %
Dtbench
0.68 %
Enigma Eval
0.01 %
Forecastbench
0.61 %
FrontierMath
0.02 %
GPQA Diamond
0.55 %
Hle
0.04 %
Lech Mazur Writing
0.08 %
Live bench
0.59 %
Math Level 5
0.57 %
Mmlu
0.87 %
OTIS Mock AIME 2024 2025
0.08 %
SimpleBench
0.41 %
WeirdML
0.40 %
claude-3-5-sonnet-20241022 benchmark results.