WRSWorld Research StateContribute
WORLD RESEARCH STATE

DeepSeek-AI: lightning-indexed sparse attention and agentic training

Contribution grade

Sparse attention and reasoning-training systems · Human-designed research method or resource

Reference score105,000Provisional editorial estimate of this exact contribution; its grade is assessed separately.

What changed

Added a low-cost lightning indexer with top-k latent KV selection and staged dense-to-sparse continued training, alongside scalable reasoning/tool-use training and synthetic interactive tasks.

Scientific scope

Added a low-cost lightning indexer with top-k latent KV selection and staged dense-to-sparse continued training, alongside scalable reasoning/tool-use training and synthetic interactive tasks. MLA/MQA and prior RL are inherited. Sparse main attention does not eliminate the indexer's pairwise scoring cost or guarantee equivalence to dense attention. September experimental and December full releases share DSA; Speciale benchmark claims are not official competition participation.

Evidence

The linked original sources describe the stated contribution and its evidence limits. WRS has not independently rerun the experiments or certified a proof. MLA/MQA and prior RL are inherited. Sparse main attention does not eliminate the indexer's pairwise scoring cost or guarantee equivalence to dense attention. September experimental and December full releases share DSA; Speciale benchmark claims are not official competition participation.

Contributors

Provisional WRS assessment, edition 2026-10-16.1. Independent expert calibration is pending. This grade does not certify correctness or assign ownership.

Full scientific record · Browse contribution grades · Request a correction