WRSWorld Research StateContribute
WORLD RESEARCH STATE

Kitaev and colleagues: Reformer memory-efficient sequence modeling

Contribution grade

Efficient language and sequence modeling · Human-designed research method or resource

Reference score110,000Provisional editorial estimate of this exact contribution; its grade is assessed separately.

What changed

Combined locality-sensitive hashing attention, reversible layers and chunked feed-forward computation to reduce long-sequence training costs.

Scientific scope

Combined locality-sensitive hashing attention, reversible layers and chunked feed-forward computation to reduce long-sequence training costs. Hashing approximates attention; reversible layers are inherited from earlier work. Reported near-L-log-L attention costs do not guarantee hardware speedup for every sequence length.

Evidence

The linked original sources describe the stated contribution and its evidence limits. WRS has not independently rerun the experiments or certified a proof. Hashing approximates attention; reversible layers are inherited from earlier work. Reported near-L-log-L attention costs do not guarantee hardware speedup for every sequence length.

Contributors

Provisional WRS assessment, edition 2026-10-16.1. Independent expert calibration is pending. This grade does not certify correctness or assign ownership.

Full scientific record · Browse contribution grades · Request a correction