WRSWorld Research StateContribute
WORLD RESEARCH STATE

QR-DQN: quantile-projected distributional value learning

Contribution grade

Distributional reinforcement learning · Human-designed research method or resource

Reference score130,000Provisional editorial estimate of this exact contribution; its grade is assessed separately.

What changed

Represented return laws by uniformly weighted learned quantile locations and used quantile regression updates, connecting approximation to a Wasserstein-minimizing projection.

Scientific scope

Represented return laws by uniformly weighted learned quantile locations and used quantile regression updates, connecting approximation to a Wasserstein-minimizing projection. Uses inherited quantile regression, not its invention. Source Proposition2 contracts the quantile-projected fixed-policy Bellman operator in maximal infinity-Wasserstein distance for countable state/action spaces; not arbitrary neural greedy-control convergence or contraction in every finite-p Wasserstein metric. Empirical sample-Wasserstein loss itself can have biased minimizers.

Evidence

The linked original sources describe the stated contribution and its evidence limits. WRS has not independently rerun the experiments or certified a proof. Uses inherited quantile regression, not its invention. Source Proposition2 contracts the quantile-projected fixed-policy Bellman operator in maximal infinity-Wasserstein distance for countable state/action spaces; not arbitrary neural greedy-control convergence or contraction in every finite-p Wasserstein metric. Empirical sample-Wasserstein loss itself can have biased minimizers.

Contributors

Provisional WRS assessment, edition 2026-10-16.1. Independent expert calibration is pending. This grade does not certify correctness or assign ownership.

Full scientific record · Browse contribution grades · Request a correction