WRSWorld Research StateContribute
WORLD RESEARCH STATE

Diffusion-QL: Q-guided training of expressive diffusion action policies

Contribution grade

Offline reinforcement learning · Human-designed research method or resource

Reference score115,000Provisional editorial estimate of this exact contribution; its grade is assessed separately.

What changed

Combined conditional action-denoising behavior regularization with Q-value maximization, backpropagating the Q objective through the reverse diffusion chain and learning twin critics from offline transitions.

Scientific scope

Combined conditional action-denoising behavior regularization with Q-value maximization, backpropagating the Q objective through the reverse diffusion chain and learning twin critics from offline transitions. The method learns single-action policies, not Diffuser's full-trajectory planner. Denoising-chain evaluation and differentiation cost remain; near-behavior regularization and benchmark gains are not universal safety or optimality guarantees. The preprint document is dated 15 August 2022, while its arXiv submission is dated 12 August 2022; these are different bibliographic dates.

Evidence

The linked original sources describe the stated contribution and its evidence limits. WRS has not independently rerun the experiments or certified a proof. The method learns single-action policies, not Diffuser's full-trajectory planner. Denoising-chain evaluation and differentiation cost remain; near-behavior regularization and benchmark gains are not universal safety or optimality guarantees. The preprint document is dated 15 August 2022, while its arXiv submission is dated 12 August 2022; these are different bibliographic dates.

Contributors

Provisional WRS assessment, edition 2026-10-16.1. Independent expert calibration is pending. This grade does not certify correctness or assign ownership.

Full scientific record · Browse contribution grades · Request a correction