WRSWorld Research StateContribute
WORLD RESEARCH STATE

Qwen Team: multi-codebook first-frame streaming in omni models

Contribution grade

Low-latency multimodal speech generation · Human-designed research method or resource

Reference score65,000Provisional editorial estimate of this exact contribution; its grade is assessed separately.

What changed

Combined a Thinker-Talker mixture-of-experts system with multi-codebook speech prediction and a lightweight causal waveform decoder to start streaming from the first codec frame.

Scientific scope

Combined a Thinker-Talker mixture-of-experts system with multi-codebook speech prediction and a lightweight causal waveform decoder to start streaming from the first codec frame. Thinker-Talker is inherited from2.5Omni; the codec-frame/decoder and joint-training delta is distinct. Reported234ms is a theoretical cold-start figure, not guaranteed end-to-end service latency. Captioner/thinking/model sizes remain one package.

Evidence

The linked original sources describe the stated contribution and its evidence limits. WRS has not independently rerun the experiments or certified a proof. Thinker-Talker is inherited from2.5Omni; the codec-frame/decoder and joint-training delta is distinct. Reported234ms is a theoretical cold-start figure, not guaranteed end-to-end service latency. Captioner/thinking/model sizes remain one package.

Contributors

Provisional WRS assessment, edition 2026-10-16.1. Independent expert calibration is pending. This grade does not certify correctness or assign ownership.

Full scientific record · Browse contribution grades · Request a correction