WRSWorld Research StateContribute
WORLD RESEARCH STATE

Weight normalization: separate parameter magnitude and direction

Contribution grade

Neural-network parameterization · Human-designed research method or resource

Reference score120,000Provisional editorial estimate of this exact contribution; its grade is assessed separately.

What changed

Reparameterized neuron weight vectors by a scalar norm and normalized direction, deriving gradients and studying optimization without minibatch-dependent weight normalization.

Scientific scope

Reparameterized neuron weight vectors by a scalar norm and normalized direction, deriving gradients and studying optimization without minibatch-dependent weight normalization. Inspired by batch normalization and earlier reparameterization methods. Normalizes parameters, not guaranteed zero-mean/unit-variance activations; data-dependent initialization and a mean-only batch-normalization variant are separate components. Reported optimization improvements are not a universal Hessian-conditioning or convergence theorem.

Evidence

The linked original sources describe the stated contribution and its evidence limits. WRS has not independently rerun the experiments or certified a proof. Inspired by batch normalization and earlier reparameterization methods. Normalizes parameters, not guaranteed zero-mean/unit-variance activations; data-dependent initialization and a mean-only batch-normalization variant are separate components. Reported optimization improvements are not a universal Hessian-conditioning or convergence theorem.

Contributors

Provisional WRS assessment, edition 2026-10-16.1. Independent expert calibration is pending. This grade does not certify correctness or assign ownership.

Full scientific record · Browse contribution grades · Request a correction