WRSWorld Research StateContribute
WORLD RESEARCH STATE

Sutton: learning to predict by temporal differences

Contribution grade

Reinforcement learning · Prediction algorithms

Reference score190,000Provisional editorial estimate of this exact contribution; its grade is assessed separately.

What changed

Prediction could be learned incrementally from temporal differences without waiting for a final outcome.

Scientific scope

The 1988 sole-authored paper; not later TD(lambda), Q-learning, control, or all RL convergence.

Evidence

The linked sources identify this contribution and its scope. WRS has not independently reconstructed the scientific claims. The paper proves convergence and optimality only under stated special cases; this record does not transfer those guarantees to all later temporal-difference or reinforcement-learning algorithms.

Contributors

Provisional WRS assessment, edition 2026-10-16.1. Independent expert calibration is pending. This grade does not certify correctness or assign ownership.

Full scientific record · Browse contribution grades · Request a correction