WRSWorld Research StateContribute
WORLD RESEARCH STATE

IQL: in-sample expectile value learning with advantage-weighted policy extraction

Contribution grade

Offline reinforcement learning · Human-designed research method or resource

Reference score145,000Provisional editorial estimate of this exact contribution; its grade is assessed separately.

What changed

Fitted an upper expectile of action values conditional on state, backed it into a Q-function while averaging transition noise, and extracted a policy by advantage-weighted regression.

Scientific scope

Fitted an upper expectile of action values conditional on state, backed it into a Q-function while averaging transition noise, and extracted a policy by advantage-weighted regression. Expectiles over data-supported actions are not return quantiles. Avoiding unseen actions in the training losses does not certify the deployed policy stays in support or improves for every dataset; near-maximal limits and finite nonlinear approximation are separate.

Evidence

The linked original sources describe the stated contribution and its evidence limits. WRS has not independently rerun the experiments or certified a proof. Expectiles over data-supported actions are not return quantiles. Avoiding unseen actions in the training losses does not certify the deployed policy stays in support or improves for every dataset; near-maximal limits and finite nonlinear approximation are separate.

Contributors

Provisional WRS assessment, edition 2026-10-16.1. Independent expert calibration is pending. This grade does not certify correctness or assign ownership.

Full scientific record · Browse contribution grades · Request a correction