This website uses cookies for authentication, support chat, and analytics. Only authentication cookies are turned on by default.
Animate this data
Bar chart race of claude-3-5-haiku-20241022, gemini-4-argon_high, gpt-6-astra_max and 7 more, by GPQA Diamond.
Create it free
Takes a free account

claude-3-5-haiku-20241022

Aider Polyglot
28 %
BALROG
19 %
Cad Eval
32 %
Dtbench
57 %
FrontierMath
0 %
GPQA Diamond
38 %
Lech Mazur Writing
7 %
Live bench
43 %
Math Level 5
46 %
Mmlu
74 %
OTIS Mock AIME 2024 2025
4 %
SciCode
27 %
WeirdML
31 %
claude-3-5-haiku-20241022 benchmark results.

Aider Polyglot Monthly

Aider Polyglot score.

Aider Polyglot Yearly

Aider Polyglot score.

BALROG Monthly

BALROG score.

BALROG Yearly

BALROG score.

Cad Eval Monthly

Cad Eval score.

Cad Eval Yearly

Cad Eval score.

Critpt Monthly

Critpt score.

Critpt Yearly

Critpt score.

Dtbench Monthly

Dtbench score.

Dtbench Yearly

Dtbench score.

FrontierMath Monthly

FrontierMath score.

FrontierMath Yearly

FrontierMath score.

GPQA Diamond Monthly

GPQA Diamond score.

GPQA Diamond Yearly

GPQA Diamond score.

Lech Mazur Writing Monthly

Lech Mazur Writing score.

Lech Mazur Writing Yearly

Lech Mazur Writing score.

Live bench Monthly

Live bench score.

Live bench Yearly

Live bench score.

Math Level 5 Monthly

Math Level 5 score.

Math Level 5 Yearly

Math Level 5 score.

Mmlu Monthly

Mmlu score.

Mmlu Yearly

Mmlu score.

OTIS Mock AIME 2024 2025 Monthly

OTIS Mock AIME 2024 2025 score.

OTIS Mock AIME 2024 2025 Yearly

OTIS Mock AIME 2024 2025 score.

SciCode Monthly

SciCode score.

SciCode Yearly

SciCode score.

WeirdML Monthly

WeirdML score.

WeirdML Yearly

WeirdML score.