This website uses cookies for authentication, support chat, and analytics. Only authentication cookies are turned on by default.
Animate this data
Bar chart race of claude-sonnet-4-20250514, gemini-4-argon_high, gpt-6-astra_max and 7 more, by GPQA Diamond.
Create it free
Takes a free account

claude-sonnet-4-20250514

Aider Polyglot
56 %
Arc Agi
24 %
Arc Agi 2
1 %
FrontierMath
4 %
GPQA Diamond
67 %
Lech Mazur Writing
8 %
Math Level 5
84 %
Os World
44 %
OTIS Mock AIME 2024 2025
29 %
WeirdML
44 %
claude-sonnet-4-20250514 benchmark results.

Aider Polyglot Monthly

Aider Polyglot score.

Aider Polyglot Yearly

Aider Polyglot score.

Arc Agi Monthly

Arc Agi score.

Arc Agi Yearly

Arc Agi score.

Arc Agi 2 Monthly

Arc Agi 2 score.

Arc Agi 2 Yearly

Arc Agi 2 score.

FrontierMath Monthly

FrontierMath score.

FrontierMath Yearly

FrontierMath score.

FrontierMath Tier 4 Monthly

FrontierMath Tier 4 score.

FrontierMath Tier 4 Yearly

FrontierMath Tier 4 score.

GPQA Diamond Monthly

GPQA Diamond score.

GPQA Diamond Yearly

GPQA Diamond score.

Lech Mazur Writing Monthly

Lech Mazur Writing score.

Lech Mazur Writing Yearly

Lech Mazur Writing score.

Math Level 5 Monthly

Math Level 5 score.

Math Level 5 Yearly

Math Level 5 score.

Os World Monthly

Os World score.

Os World Yearly

Os World score.

OTIS Mock AIME 2024 2025 Monthly

OTIS Mock AIME 2024 2025 score.

OTIS Mock AIME 2024 2025 Yearly

OTIS Mock AIME 2024 2025 score.

WeirdML Monthly

WeirdML score.

WeirdML Yearly

WeirdML score.