This website uses cookies for authentication, support chat, and analytics. Only authentication cookies are turned on by default.
Animate this data
Bar chart race of claude-3-5-sonnet-20241022, gemini-4-argon_high, gpt-6-astra_max and 7 more, by GPQA Diamond.
Create it free
Takes a free account
claude-3-5-sonnet-20241022
Aider Polyglot
52 %
BALROG
33 %
Cad Eval
48 %
Dtbench
68 %
Enigma Eval
1 %
Forecastbench
63 %
FrontierMath
2 %
GPQA Diamond
55 %
Hle
4 %
Lech Mazur Writing
8 %
Live bench
59 %
Math Level 5
57 %
Mmlu
87 %
OTIS Mock AIME 2024 2025
8 %
SimpleBench
41 %
WeirdML
40 %
claude-3-5-sonnet-20241022 benchmark results.