This website uses cookies for authentication, support chat, and analytics. Only authentication cookies are turned on by default.
Animate this data
Bar chart race of Llama-4-Scout-17B-16E-Instruct, gemini-4-argon_high, gpt-6-astra_max and 7 more, by GPQA Diamond.
Create it free
Takes a free account

Llama-4-Scout-17B-16E-Instruct

Arc Agi
1 %
Dtbench
58 %
Forecastbench
59 %
GPQA Diamond
52 %
Lmca
12 %
Math Level 5
62 %
OTIS Mock AIME 2024 2025
8 %
SciCode
21 %
Spatialviz bench
34 %
Training Compute
4,080,000,000,000.00T FLOP
Llama-4-Scout-17B-16E-Instruct benchmark results.

Arc Agi Monthly

Arc Agi score.

Arc Agi Yearly

Arc Agi score.

Arc Agi 2 Monthly

Arc Agi 2 score.

Arc Agi 2 Yearly

Arc Agi 2 score.

Critpt Monthly

Critpt score.

Critpt Yearly

Critpt score.

Dtbench Monthly

Dtbench score.

Dtbench Yearly

Dtbench score.

Forecastbench Monthly

Forecastbench score.

Forecastbench Yearly

Forecastbench score.

FrontierMath Monthly

FrontierMath score.

FrontierMath Yearly

FrontierMath score.

GPQA Diamond Monthly

GPQA Diamond score.

GPQA Diamond Yearly

GPQA Diamond score.

Lmca Monthly

Lmca score.

Lmca Yearly

Lmca score.

Math Level 5 Monthly

Math Level 5 score.

Math Level 5 Yearly

Math Level 5 score.

OTIS Mock AIME 2024 2025 Monthly

OTIS Mock AIME 2024 2025 score.

OTIS Mock AIME 2024 2025 Yearly

OTIS Mock AIME 2024 2025 score.

SciCode Monthly

SciCode score.

SciCode Yearly

SciCode score.

Spatialviz bench Monthly

Spatialviz bench score.

Spatialviz bench Yearly

Spatialviz bench score.