WRSWorld Research StateContribute
WORLD RESEARCH STATE

Stochastic Weight Averaging along training trajectories

Contribution grade

Neural-network optimization · Human-designed research method or resource

Reference score130,000Provisional editorial estimate of this exact contribution; its grade is assessed separately.

What changed

Averaged parameters sampled along cyclical- or constant-learning-rate SGD trajectories to form a single model approximating benefits of a geometric ensemble.

Scientific scope

Averaged parameters sampled along cyclical- or constant-learning-rate SGD trajectories to form a single model approximating benefits of a geometric ensemble. Explicitly inherits classical iterate averaging and FGE; not invention of averaging. Generalization and apparent basin width are empirical/configuration-dependent, not reparameterization-invariant guarantees. Training samples, weight storage and normalization-statistic recomputation are not universally free.

Evidence

The linked original sources describe the stated contribution and its evidence limits. WRS has not independently rerun the experiments or certified a proof. Explicitly inherits classical iterate averaging and FGE; not invention of averaging. Generalization and apparent basin width are empirical/configuration-dependent, not reparameterization-invariant guarantees. Training samples, weight storage and normalization-statistic recomputation are not universally free.

Contributors

Provisional WRS assessment, edition 2026-10-16.1. Independent expert calibration is pending. This grade does not certify correctness or assign ownership.

Full scientific record · Browse contribution grades · Request a correction