WRSWorld Research StateContribute
WORLD RESEARCH STATE

GELU: Gaussian-CDF-weighted neural activation

Contribution grade

Neural-network activation functions · Human-designed research method or resource

Reference score175,000Provisional editorial estimate of this exact contribution; its grade is assessed separately.

What changed

Defined a smooth input-weighted activation through the expected action of an input-dependent stochastic identity/zero map, with Gaussian cumulative probabilities and empirical neural-network evaluations.

Scientific scope

Defined a smooth input-weighted activation through the expected action of an input-dependent stochastic identity/zero map, with Gaussian cumulative probabilities and empirical neural-network evaluations. Original2016v1 title differs from later Gaussian Error Linear Units title. The deterministic expected map is not dropout randomness during inference; its Gaussian motivation is not a guarantee that every layer is normally distributed. No universal superiority, earliest claim for every sigmoid-weighted variant or independent approximation-theorem certification.

Evidence

The linked original sources describe the stated contribution and its evidence limits. WRS has not independently rerun the experiments or certified a proof. Original2016v1 title differs from later Gaussian Error Linear Units title. The deterministic expected map is not dropout randomness during inference; its Gaussian motivation is not a guarantee that every layer is normally distributed. No universal superiority, earliest claim for every sigmoid-weighted variant or independent approximation-theorem certification.

Contributors

Provisional WRS assessment, edition 2026-10-16.1. Independent expert calibration is pending. This grade does not certify correctness or assign ownership.

Full scientific record · Browse contribution grades · Request a correction