AWhat changed
Combined lightweight sharding annotations with XLA compiler support to express distributed computation, scaling multilingual sparse-expert Transformer training with automated partitioning.
Scientific scope
Combined lightweight sharding annotations with XLA compiler support to express distributed computation, scaling multilingual sparse-expert Transformer training with automated partitioning. Inherits XLA, SPMD and sparsely gated MoE; not invention of mixture-of-experts or later GSPMD's full design.600Bparameters and2048TPUv3/4day figures are a specific multilingual-translation experiment, not dense-model-equivalent per-token compute, universal translation quality or general automatic partition optimality.
Evidence
The linked original sources describe the stated contribution and its evidence limits. WRS has not independently rerun the experiments or certified a proof. Inherits XLA, SPMD and sparsely gated MoE; not invention of mixture-of-experts or later GSPMD's full design.600Bparameters and2048TPUv3/4day figures are a specific multilingual-translation experiment, not dense-model-equivalent per-token compute, universal translation quality or general automatic partition optimality.
Contributors
- Source-listed authors and technical contributors · SCIENCE: Source-listed authors or explicitly credited technical contributors for the cited versions. Family entries retain source-specific attribution; a combined list is not one original-paper byline or equal individual work. Names alone do not establish resolved identities.
Provisional WRS assessment, edition 2026-10-16.1. Independent expert calibration is pending. This grade does not certify correctness or assign ownership.
Full scientific record · Browse contribution grades · Request a correction