AWhat changed
Quantized stochastic gradients with controllable unbiased rounding and bounded second moments, then encoded the sparse/low-precision updates to trade communication against optimization iterations.
Scientific scope
Quantized stochastic gradients with controllable unbiased rounding and bounded second moments, then encoded the sparse/low-precision updates to trade communication against optimization iterations. Pinned original four-author 2016 version, not later expanded byline. Inherits SGD and 1-bit compression predecessors. Sublinear bits per iteration can require more iterations; communication-optimal claims concern specified convex/distributed models, not arbitrary deep networks or universally faster wall-clock training. Lossless coding is applied after lossy quantization, not lossless reconstruction of the original gradient.
Evidence
The linked original sources describe the stated contribution and its evidence limits. WRS has not independently rerun the experiments or certified a proof. Pinned original four-author 2016 version, not later expanded byline. Inherits SGD and 1-bit compression predecessors. Sublinear bits per iteration can require more iterations; communication-optimal claims concern specified convex/distributed models, not arbitrary deep networks or universally faster wall-clock training. Lossless coding is applied after lossy quantization, not lossless reconstruction of the original gradient.
Contributors
- Source-listed authors and technical contributors · SCIENCE: Source-listed authors or explicitly credited technical contributors for the cited versions. Family entries retain source-specific attribution; a combined list is not one original-paper byline or equal individual work. Names alone do not establish resolved identities.
Provisional WRS assessment, edition 2026-10-16.1. Independent expert calibration is pending. This grade does not certify correctness or assign ownership.
Full scientific record · Browse contribution grades · Request a correction