WRSWorld Research StateContribute
WORLD RESEARCH STATE

R2D2 recurrent experience replay with stored state and burn-in

Contribution grade

Distributed recurrent reinforcement learning · Human-designed research method or resource

Reference score145,000Provisional editorial estimate of this exact contribution; its grade is assessed separately.

What changed

Combines recurrent Q-learning and prioritized distributed sequence replay, storing recurrent states and using burn-in to reduce training-state mismatch and representational staleness.

Scientific scope

Combines recurrent Q-learning and prioritized distributed sequence replay, storing recurrent states and using burn-in to reduce training-state mismatch and representational staleness. The record concerns the published recurrent-replay method, rather than a mixture of draft-specific performance figures. It builds on Ape-X, DQN, recurrent networks and prioritized replay. Burn-in and stored states mitigate staleness empirically; they do not guarantee convergence or recovery of an arbitrary complete history.

Evidence

The linked original sources describe the stated contribution and its evidence limits. WRS has not independently rerun the experiments or certified a proof. The record concerns the published recurrent-replay method, rather than a mixture of draft-specific performance figures. It builds on Ape-X, DQN, recurrent networks and prioritized replay. Burn-in and stored states mitigate staleness empirically; they do not guarantee convergence or recovery of an arbitrary complete history.

Contributors

Provisional WRS assessment, edition 2026-10-16.1. Independent expert calibration is pending. This grade does not certify correctness or assign ownership.

Full scientific record · Browse contribution grades · Request a correction