This website uses cookies for authentication, support chat, and analytics. Only authentication cookies are turned on by default.
Don’t Enable
Enable All
Statistics
Templates
Feed
Public Projects
Log In
Animate this data
Bar chart race of claude-3-5-haiku-20241022, gemini-4-argon_high, gpt-6-astra_max and 7 more, by GPQA Diamond.
Create it free
Takes a free account
claude-3-5-haiku-20241022
Aider Polyglot
28 %
BALROG
19 %
Cad Eval
32 %
Dtbench
57 %
FrontierMath
0 %
GPQA Diamond
38 %
Lech Mazur Writing
7 %
Live bench
43 %
Math Level 5
46 %
Mmlu
74 %
OTIS Mock AIME 2024 2025
4 %
SciCode
27 %
WeirdML
31 %
claude-3-5-haiku-20241022 benchmark results.
Aider Polyglot Monthly
Aider Polyglot score.
Aider Polyglot Yearly
Aider Polyglot score.
BALROG Monthly
BALROG score.
BALROG Yearly
BALROG score.
Cad Eval Monthly
Cad Eval score.
Cad Eval Yearly
Cad Eval score.
Critpt Monthly
Critpt score.
Critpt Yearly
Critpt score.
Dtbench Monthly
Dtbench score.
Dtbench Yearly
Dtbench score.
FrontierMath Monthly
FrontierMath score.
FrontierMath Yearly
FrontierMath score.
GPQA Diamond Monthly
GPQA Diamond score.
GPQA Diamond Yearly
GPQA Diamond score.
Lech Mazur Writing Monthly
Lech Mazur Writing score.
Lech Mazur Writing Yearly
Lech Mazur Writing score.
Live bench Monthly
Live bench score.
Live bench Yearly
Live bench score.
Math Level 5 Monthly
Math Level 5 score.
Math Level 5 Yearly
Math Level 5 score.
Mmlu Monthly
Mmlu score.
Mmlu Yearly
Mmlu score.
OTIS Mock AIME 2024 2025 Monthly
OTIS Mock AIME 2024 2025 score.
OTIS Mock AIME 2024 2025 Yearly
OTIS Mock AIME 2024 2025 score.
SciCode Monthly
SciCode score.
SciCode Yearly
SciCode score.
WeirdML Monthly
WeirdML score.
WeirdML Yearly
WeirdML score.
Data Source
Epoch AI, 'Capabilities & Benchmarking'. Published online at epoch.ai.
Related
Chinchilla (70B)
chutes/Llama-4-Maverick-17B-128E-Instruct
claude-1.3
claude-2.0
claude-2.1
claude-3-5-sonnet-20240620
claude-3-5-sonnet-20241022
claude-3-7-sonnet-20250219
claude-3-7-sonnet-20250219_12K
claude-3-7-sonnet-20250219_16K
View all in AI Benchmarks by Model
Updates
Tutorials
Language
English
Projects
Feed
Explore
Templates
Sign in
Log In
Statistics
Templates
Feed
Public Projects
Earn
Feature Requests
Blog
Theme
Language
English
Terms
Privacy
v3.65.1