This website uses cookies for authentication, support chat, and analytics. Only authentication cookies are turned on by default.
Animate this data
Bar chart race of claude-3-5-sonnet-20240620, gemini-4-argon_high, gpt-6-astra_max and 7 more, by GPQA Diamond.
Create it free
Takes a free account

claude-3-5-sonnet-20240620

Dtbench
68 %
Forecastbench
63 %
FrontierMath
1 %
GPQA Diamond
54 %
Math Level 5
52 %
Mmlu
87 %
OTIS Mock AIME 2024 2025
7 %
SimpleBench
28 %
WeirdML
31 %
Training Compute
27,000,000,000,000.01T FLOP
claude-3-5-sonnet-20240620 benchmark results.

Dtbench Monthly

Dtbench score.

Dtbench Yearly

Dtbench score.

Forecastbench Monthly

Forecastbench score.

Forecastbench Yearly

Forecastbench score.

FrontierMath Monthly

FrontierMath score.

FrontierMath Yearly

FrontierMath score.

FrontierMath Tier 4 Monthly

FrontierMath Tier 4 score.

FrontierMath Tier 4 Yearly

FrontierMath Tier 4 score.

GPQA Diamond Monthly

GPQA Diamond score.

GPQA Diamond Yearly

GPQA Diamond score.

Math Level 5 Monthly

Math Level 5 score.

Math Level 5 Yearly

Math Level 5 score.

Mmlu Monthly

Mmlu score.

Mmlu Yearly

Mmlu score.

OTIS Mock AIME 2024 2025 Monthly

OTIS Mock AIME 2024 2025 score.

OTIS Mock AIME 2024 2025 Yearly

OTIS Mock AIME 2024 2025 score.

SimpleBench Monthly

SimpleBench score.

SimpleBench Yearly

SimpleBench score.

WeirdML Monthly

WeirdML score.

WeirdML Yearly

WeirdML score.