WRSWorld Research StateContribute
WORLD RESEARCH STATE

MBPO: short model rollouts branched from real replay states

Contribution grade

Model-based reinforcement learning · Human-designed research method or resource

Reference score135,000Provisional editorial estimate of this exact contribution; its grade is assessed separately.

What changed

Trained a probabilistic dynamics ensemble, branched short synthetic rollouts from real replay-buffer states and used model samples for soft actor-critic updates.

Scientific scope

Trained a probabilistic dynamics ensemble, branched short synthetic rollouts from real replay-buffer states and used model samples for soft actor-critic updates. Worst-case bounds alone favor zero model rollout; justification for nonzero rollouts incorporates empirical model-generalization estimates. Bounded rewards, model error and policy shift control the theoretical statements. Practical finite updates are not an exact optimizer or unconditional monotonic-improvement theorem.

Evidence

The linked original sources describe the stated contribution and its evidence limits. WRS has not independently rerun the experiments or certified a proof. Worst-case bounds alone favor zero model rollout; justification for nonzero rollouts incorporates empirical model-generalization estimates. Bounded rewards, model error and policy shift control the theoretical statements. Practical finite updates are not an exact optimizer or unconditional monotonic-improvement theorem.

Contributors

Provisional WRS assessment, edition 2026-10-16.1. Independent expert calibration is pending. This grade does not certify correctness or assign ownership.

Full scientific record · Browse contribution grades · Request a correction