WRSWorld Research StateContribute
WORLD RESEARCH STATE

Schlag et al.: error-correcting fast-weight programming for linear attention

Contribution grade

Associative sequence memory · Human-designed research method or resource

Reference score120,000Provisional editorial estimate of this exact contribution; its grade is assessed separately.

What changed

Related linear attention to normalized outer-product fast-weight programmers and replaced additive writes with a learned-strength delta update that corrects the value currently associated with a key.

Scientific scope

Related linear attention to normalized outer-product fast-weight programmers and replaced additive writes with a learned-strength delta update that corrects the value currently associated with a key. Fast weights date to the1990s and error-correcting delta rules are older. Acquired contribution is their differentiable linear-attention formulation, not invention of memory/delta learning. Later DeltaNet sequence parallelization is distinct; no unlimited-capacity claim.

Evidence

The linked original sources describe the stated contribution and its evidence limits. WRS has not independently rerun the experiments or certified a proof. Fast weights date to the1990s and error-correcting delta rules are older. Acquired contribution is their differentiable linear-attention formulation, not invention of memory/delta learning. Later DeltaNet sequence parallelization is distinct; no unlimited-capacity claim.

Contributors

Provisional WRS assessment, edition 2026-10-16.1. Independent expert calibration is pending. This grade does not certify correctness or assign ownership.

Full scientific record · Browse contribution grades · Request a correction