This website uses cookies for authentication, support chat, and analytics. Only authentication cookies are turned on by default.
Animate this data
Bar chart race of claude-3-7-sonnet-20250219, gemini-4-argon_high, gpt-6-astra_max and 7 more, by GPQA Diamond.
Create it free
Takes a free account

claude-3-7-sonnet-20250219

Aider Polyglot
60 %
Arc Agi
14 %
Cad Eval
54 %
Enigma Eval
2 %
FrontierMath
3 %
GPQA Diamond
66 %
Lech Mazur Writing
8 %
Live bench
76 %
Math Level 5
68 %
Os World
36 %
OTIS Mock AIME 2024 2025
22 %
SimpleBench
45 %
SWE bench Verified
61 %
Training Compute
33,500,000,000,000.00T FLOP
claude-3-7-sonnet-20250219 benchmark results.

Aider Polyglot Monthly

Aider Polyglot score.

Aider Polyglot Yearly

Aider Polyglot score.

Arc Agi Monthly

Arc Agi score.

Arc Agi Yearly

Arc Agi score.

Arc Agi 2 Monthly

Arc Agi 2 score.

Arc Agi 2 Yearly

Arc Agi 2 score.

Cad Eval Monthly

Cad Eval score.

Cad Eval Yearly

Cad Eval score.

Enigma Eval Monthly

Enigma Eval score.

Enigma Eval Yearly

Enigma Eval score.

FrontierMath Monthly

FrontierMath score.

FrontierMath Yearly

FrontierMath score.

GPQA Diamond Monthly

GPQA Diamond score.

GPQA Diamond Yearly

GPQA Diamond score.

Lech Mazur Writing Monthly

Lech Mazur Writing score.

Lech Mazur Writing Yearly

Lech Mazur Writing score.

Live bench Monthly

Live bench score.

Live bench Yearly

Live bench score.

Math Level 5 Monthly

Math Level 5 score.

Math Level 5 Yearly

Math Level 5 score.

Os World Monthly

Os World score.

Os World Yearly

Os World score.

OTIS Mock AIME 2024 2025 Monthly

OTIS Mock AIME 2024 2025 score.

OTIS Mock AIME 2024 2025 Yearly

OTIS Mock AIME 2024 2025 score.

SimpleBench Monthly

SimpleBench score.

SimpleBench Yearly

SimpleBench score.

SWE bench Verified Monthly

SWE bench Verified score.

SWE bench Verified Yearly

SWE bench Verified score.