WRSWorld Research StateContribute
WORLD RESEARCH STATE

CQL: conservative value regularization for offline reinforcement learning

Contribution grade

Offline reinforcement learning · Human-designed research method or resource

Reference score160,000Provisional editorial estimate of this exact contribution; its grade is assessed separately.

What changed

Augmented Bellman regression with a conservative Q-value penalty, contrasting policy/proposal actions with data actions to reduce value overestimation during offline learning.

Scientific scope

Augmented Bellman regression with a conservative Q-value penalty, contrasting policy/proposal actions with data actions to reduce value overestimation during offline learning. The tighter objective bounds policy-expected value under stated support, regularization and policy-change assumptions; it is not a pointwise lower bound for every action. Main tabular statements and practical nonlinear optimization are distinct; empirical results do not certify universal safe improvement.

Evidence

The linked original sources describe the stated contribution and its evidence limits. WRS has not independently rerun the experiments or certified a proof. The tighter objective bounds policy-expected value under stated support, regularization and policy-change assumptions; it is not a pointwise lower bound for every action. Main tabular statements and practical nonlinear optimization are distinct; empirical results do not certify universal safe improvement.

Contributors

Provisional WRS assessment, edition 2026-10-16.1. Independent expert calibration is pending. This grade does not certify correctness or assign ownership.

Full scientific record · Browse contribution grades · Request a correction