WRSWorld Research StateContribute
WORLD RESEARCH STATE

ByteDance Seed: streaming rollout and mixed-reward reasoning training

Contribution grade

Reasoning-model reinforcement-learning systems · Human-designed research method or resource

Reference score75,000Provisional editorial estimate of this exact contribution; its grade is assessed separately.

What changed

Integrated reasoning-based answer verification and pairwise preference rewards with online prompt-distribution adaptation and a streaming rollout scheduler that continues partial generations across policy versions.

Scientific scope

Integrated reasoning-based answer verification and pairwise preference rewards with online prompt-distribution adaptation and a streaming rollout scheduler that continues partial generations across policy versions. VAPO, DAPO, HybridFlow, KARP and ByteCheckpoint are inherited or separately described methods, not newly invented by this integration. LLM verification is fallible; partial off-policy generations introduce policy-lag concerns. Internal benchmark results are source-reported, and promised benchmark release is not verified here.

Evidence

The linked original sources describe the stated contribution and its evidence limits. WRS has not independently rerun the experiments or certified a proof. VAPO, DAPO, HybridFlow, KARP and ByteCheckpoint are inherited or separately described methods, not newly invented by this integration. LLM verification is fallible; partial off-policy generations introduce policy-lag concerns. Internal benchmark results are source-reported, and promised benchmark release is not verified here.

Contributors

Provisional WRS assessment, edition 2026-10-16.1. Independent expert calibration is pending. This grade does not certify correctness or assign ownership.

Full scientific record · Browse contribution grades · Request a correction