WRSWorld Research StateContribute
WORLD RESEARCH STATE

Sun and colleagues: RetNet parallel and recurrent retention

Contribution grade

Attention-alternative sequence modeling · Human-designed research method or resource

Reference score100,000Provisional editorial estimate of this exact contribution; its grade is assessed separately.

What changed

Defined multi-scale retention with parallel, recurrent and chunkwise-recurrent computations to combine parallel training and fixed-state incremental decoding.

Scientific scope

Defined multi-scale retention with parallel, recurrent and chunkwise-recurrent computations to combine parallel training and fixed-state incremental decoding. Constant per-token decoding cost fixes model/state dimensions; it is not constant cost for an entire sequence or a proof of replacing all Transformers.

Evidence

The linked original sources describe the stated contribution and its evidence limits. WRS has not independently rerun the experiments or certified a proof. Constant per-token decoding cost fixes model/state dimensions; it is not constant cost for an entire sequence or a proof of replacing all Transformers.

Contributors

Provisional WRS assessment, edition 2026-10-16.1. Independent expert calibration is pending. This grade does not certify correctness or assign ownership.

Full scientific record · Browse contribution grades · Request a correction