Llama Team: Llama 3 model herd and large-scale training report

What changed

Documented large-scale pre-training, post-training and evaluation of the Llama 3 family, including the 405B multilingual model with extended context.

Scientific scope

Documented large-scale pre-training, post-training and evaluation of the Llama 3 family, including the 405B multilingual model with extended context. Report largely concerns the July Llama 3.1 release; its results must not all be assigned to April Llama 3. Experimental multimodal extensions were not broadly released with this report.

Evidence

The linked original sources describe the stated contribution and its evidence limits. WRS has not independently rerun the experiments or certified a proof. Report largely concerns the July Llama 3.1 release; its results must not all be assigned to April Llama 3. Experimental multimodal extensions were not broadly released with this report.

Contributors

• Source-listed authors and technical contributors · SCIENCE: Source-listed authors or explicitly credited technical contributors for the cited versions. Family entries retain source-specific attribution; a combined list is not one original-paper byline or equal individual work. Names alone do not establish resolved identities.

• The Llama 3 Herd of Models
• Llama Team: Llama 3 model herd and large-scale training report — official research record

Provisional WRS assessment, edition 2026-10-16.1. Independent expert calibration is pending. This grade does not certify correctness or assign ownership.

Full scientific record · Browse contribution grades · Request a correction