WRSWorld Research StateContribute
WORLD RESEARCH STATE

Self-normalizing networks: SELU moment stabilization

Contribution grade

Feed-forward neural-network normalization · Human-designed research method or resource

Reference score125,000Provisional editorial estimate of this exact contribution; its grade is assessed separately.

What changed

Designed scaled exponential-linear activations and compatible initialization to attract layerwise activation mean/variance toward a stable region under an analyzed moment map.

Scientific scope

Designed scaled exponential-linear activations and compatible initialization to attract layerwise activation mean/variance toward a stable region under an analyzed moment map. General ML architecture despite author affiliation and incidental application examples; no biological results entered. Moment analysis uses independent/common-moment inputs and Gaussian preactivation approximation with bounded parameter regions. Not universal self-normalization for arbitrary correlated architectures/weights, nor proof that all gradients can never vanish or explode. Only selected pages of102pagev1read.

Evidence

The linked original sources describe the stated contribution and its evidence limits. WRS has not independently rerun the experiments or certified a proof. General ML architecture despite author affiliation and incidental application examples; no biological results entered. Moment analysis uses independent/common-moment inputs and Gaussian preactivation approximation with bounded parameter regions. Not universal self-normalization for arbitrary correlated architectures/weights, nor proof that all gradients can never vanish or explode. Only selected pages of102pagev1read.

Contributors

Provisional WRS assessment, edition 2026-10-16.1. Independent expert calibration is pending. This grade does not certify correctness or assign ownership.

Full scientific record · Browse contribution grades · Request a correction