Task
Metric
Llama 4 Maverick
Llama 4 Scout
Image Reasoning
MMMU
73.4
69.4
MathVista
73.7
70.7
Image Understanding
ChartQA
90
88.8
DocVQA (test)
94.4
94.4
Coding
LiveCodeBench (10.01.2024 - 02.01.2025)
43.4
32.8
Reasoning & Knowledge
MMLU Pro
80.5
74.3
DocVQA (test)
69.8
57.2
Multilingual
Multilingual MMLU
84.6
-
Long Context
MTOB (half book)
eng->kgv/kgv->eng
54.0 / 46.4
42.2 / 36.6
MTOB (full book)
eng->kgv/kgv->eng
50.8 / 46.7
39.7 / 36.3