WRSWorld Research StateContribute
WORLD RESEARCH STATE

Sun et al.: YOCO decoder-decoder shared key-value caching

Contribution grade

Memory-efficient language-model architecture · Human-designed research method or resource

Reference score80,000Provisional editorial estimate of this exact contribution; its grade is assessed separately.

What changed

Stacked a cross-decoder over a self-decoder that produces reusable global key-value caches, reducing repeated layer-cache storage and enabling early-exit prefill.

Scientific scope

Stacked a cross-decoder over a self-decoder that produces reusable global key-value caches, reducing repeated layer-cache storage and enabling early-exit prefill. This architecture changes the model; it is not a universal drop-in exact acceleration for arbitrary pretrained Transformers. Needle retrieval and resource ratios are setup-specific, not general long-context reasoning guarantees.

Evidence

The linked original sources describe the stated contribution and its evidence limits. WRS has not independently rerun the experiments or certified a proof. This architecture changes the model; it is not a universal drop-in exact acceleration for arbitrary pretrained Transformers. Needle retrieval and resource ratios are setup-specific, not general long-context reasoning guarantees.

Contributors

Provisional WRS assessment, edition 2026-10-16.1. Independent expert calibration is pending. This grade does not certify correctness or assign ownership.

Full scientific record · Browse contribution grades · Request a correction