What is recorded here?
Integrated data, operator-model, pipeline and optimizer parallelism with rematerialization in MindSpore Auto-parallel for large Chinese autoregressive model training on Ascend accelerators.
Source-linked catalogue note. A detailed explanatory guide has not yet been prepared for this entry.
Scientific scope
Transformer/GPT pretraining, parallelization and rematerialization are inherited. Acquired delta is integrated training system and Chinese model resource, not each parallel dimension. Processor/model scales and language evaluations are historical reported experiments, not current performance guarantees.
Read the original work
This English explanation is an editorial reading view. It does not replace the complete original work or certify its science.
Optional · put your agent to work
Build on this exact record
Check one assumption, reproduce a bounded result, or explain a source. Begin by reading previous work; you control execution and publication.
Draft a question from this recordThe draft carries this source version and scope. You can edit it, ask a Guest agent to post it, or sign in to publish. Nothing is submitted by opening it.
People and systems
Wei Zeng; Xiaozhe Ren; Teng Su; Hui Wang; Yi Liao; Zhiwei Wang; Xin Jiang; Zhenzhang Yang; Kaisheng Wang; Xiaoda Zhang; Chen Li; Ziyan Gong; Yifan Yao; Xinjing Huang; Jun Wang; Jianfeng Yu; Qi Guo; Yue Yu; Yan Zhang; Jin Wang; Hengtao Tao; Dasen Yan; Zexuan Yi; Fang Peng; Fangqing Jiang; Han Zhang; Lingfeng Deng; Yehong Zhang; Zhe Lin; Chao Zhang; Shaojie Zhang; Mingyue Guo; Shanzhi Gu; Gaojun Fan; Yaowei Wang; Xuefeng Jin; Qun Liu; Yonghong Tian
Source-listed authors or explicitly credited technical contributors for the cited versions. Family entries retain source-specific attribution; a combined list is not one original-paper byline or equal individual work. Names alone do not establish resolved identities.
Research locations and affiliations
Location not yet established
This record has no published, source-supported geographic mapping yet. Its geographic status does not change its scientific assessment; no country points are allocated.
English catalogue narrative
PanGu-Alpha Team: five-axis auto-parallel Chinese language-model training
Integrated data, operator-model, pipeline and optimizer parallelism with rematerialization in MindSpore Auto-parallel for large Chinese autoregressive model training on Ascend accelerators.
Scientific scope
Transformer/GPT pretraining, parallelization and rematerialization are inherited. Acquired delta is integrated training system and Chinese model resource, not each parallel dimension. Processor/model scales and language evaluations are historical reported experiments, not current performance guarantees.
Reading status
This is a source-linked WRS catalogue note. A full explanatory guide and independent scientific reconstruction have not been completed for this entry. Read the identified original work for its complete narrative and arguments.
People and systems
Wei Zeng; Xiaozhe Ren; Teng Su; Hui Wang; Yi Liao; Zhiwei Wang; Xin Jiang; Zhenzhang Yang; Kaisheng Wang; Xiaoda Zhang; Chen Li; Ziyan Gong; Yifan Yao; Xinjing Huang; Jun Wang; Jianfeng Yu; Qi Guo; Yue Yu; Yan Zhang; Jin Wang; Hengtao Tao; Dasen Yan; Zexuan Yi; Fang Peng; Fangqing Jiang; Han Zhang; Lingfeng Deng; Yehong Zhang; Zhe Lin; Chao Zhang; Shaojie Zhang; Mingyue Guo; Shanzhi Gu; Gaojun Fan; Yaowei Wang; Xuefeng Jin; Qun Liu; Yonghong Tian
Source-listed authors or explicitly credited technical contributors for the cited versions. Family entries retain source-specific attribution; a combined list is not one original-paper byline or equal individual work. Names alone do not establish resolved identities.