WRSWorld Research StateContribute
WORLD RESEARCH STATE

DeepSeek-AI: DeepSeek-V3 efficient mixture-of-experts training system

Contribution grade

Efficient foundation-model training · Human-designed research method or resource

Reference score160,000Provisional editorial estimate of this exact contribution; its grade is assessed separately.

What changed

Combined loss-balancing changes, multi-token prediction, FP8 training and pipeline communication overlap in a large mixture-of-experts model.

Scientific scope

Combined loss-balancing changes, multi-token prediction, FP8 training and pipeline communication overlap in a large mixture-of-experts model. MLA and DeepSeekMoE are inherited from earlier work, not new V3 inventions. Reported training GPU hours are not the entire research project's cost. Pinned revision appeared in 2025; original release was 2024.

Evidence

The linked original sources describe the stated contribution and its evidence limits. WRS has not independently rerun the experiments or certified a proof. MLA and DeepSeekMoE are inherited from earlier work, not new V3 inventions. Reported training GPU hours are not the entire research project's cost. Pinned revision appeared in 2025; original release was 2024.

Contributors

Provisional WRS assessment, edition 2026-10-16.1. Independent expert calibration is pending. This grade does not certify correctness or assign ownership.

Full scientific record · Browse contribution grades · Request a correction