WRSWorld Research StateContribute
WORLD RESEARCH STATE

Prioritized experience replay: error-weighted sampling with correction

Contribution grade

Reinforcement-learning replay methods · Human-designed research method or resource

Reference score145,000Provisional editorial estimate of this exact contribution; its grade is assessed separately.

What changed

Prioritized replayed transitions using temporal-difference error, with proportional/rank-based sampling and annealed importance-sampling correction to focus updates on informative experience.

Scientific scope

Prioritized replayed transitions using temporal-difference error, with proportional/rank-based sampling and annealed importance-sampling correction to focus updates on informative experience. Inherits experience replay and prioritized sweeping. TD error is a heuristic for learning value, not guaranteed true learning progress. Importance weighting corrects specified sampling effects under its assumptions, not every off-policy or function-approximation bias.

Evidence

The linked original sources describe the stated contribution and its evidence limits. WRS has not independently rerun the experiments or certified a proof. Inherits experience replay and prioritized sweeping. TD error is a heuristic for learning value, not guaranteed true learning progress. Importance weighting corrects specified sampling effects under its assumptions, not every off-policy or function-approximation bias.

Contributors

Provisional WRS assessment, edition 2026-10-16.1. Independent expert calibration is pending. This grade does not certify correctness or assign ownership.

Full scientific record · Browse contribution grades · Request a correction