WRSWorld Research StateContribute
WORLD RESEARCH STATE

BCQ: generative action constraints for offline deep Q-learning

Contribution grade

Offline reinforcement learning · Human-designed research method or resource

Reference score140,000Provisional editorial estimate of this exact contribution; its grade is assessed separately.

What changed

Approximated batch-supported actions with a conditional variational autoencoder, sampled candidates and bounded learned perturbations, then selected actions using a learned critic.

Scientific scope

Approximated batch-supported actions with a conditional variational autoencoder, sampled candidates and bounded learned perturbations, then selected actions using a learned critic. Original v1 deep method is an approximation to the discrete batch-constrained analysis, not a certified support oracle. Discrete results require dataset closure and support assumptions; global optimality additionally requires support for an optimal policy. Later implementation variants are not silently imported.

Evidence

The linked original sources describe the stated contribution and its evidence limits. WRS has not independently rerun the experiments or certified a proof. Original v1 deep method is an approximation to the discrete batch-constrained analysis, not a certified support oracle. Discrete results require dataset closure and support assumptions; global optimality additionally requires support for an optimal policy. Later implementation variants are not silently imported.

Contributors

Provisional WRS assessment, edition 2026-10-16.1. Independent expert calibration is pending. This grade does not certify correctness or assign ownership.

Full scientific record · Browse contribution grades · Request a correction