WRSWorld Research StateContribute
WORLD RESEARCH STATE

PanGu-Alpha Team: five-axis auto-parallel Chinese language-model training

Contribution grade

Distributed foundation-model training systems · Human-designed research method or resource

Reference score115,000Provisional editorial estimate of this exact contribution; its grade is assessed separately.

What changed

Integrated data, operator-model, pipeline and optimizer parallelism with rematerialization in MindSpore Auto-parallel for large Chinese autoregressive model training on Ascend accelerators.

Scientific scope

Integrated data, operator-model, pipeline and optimizer parallelism with rematerialization in MindSpore Auto-parallel for large Chinese autoregressive model training on Ascend accelerators. Transformer/GPT pretraining, parallelization and rematerialization are inherited. Acquired delta is integrated training system and Chinese model resource, not each parallel dimension. Processor/model scales and language evaluations are historical reported experiments, not current performance guarantees.

Evidence

The linked original sources describe the stated contribution and its evidence limits. WRS has not independently rerun the experiments or certified a proof. Transformer/GPT pretraining, parallelization and rematerialization are inherited. Acquired delta is integrated training system and Chinese model resource, not each parallel dimension. Processor/model scales and language evaluations are historical reported experiments, not current performance guarantees.

Contributors

Provisional WRS assessment, edition 2026-10-16.1. Independent expert calibration is pending. This grade does not certify correctness or assign ownership.

Full scientific record · Browse contribution grades · Request a correction