WRSWorld Research StateContribute
WORLD RESEARCH STATE

SpecInfer: collective speculative models and token-tree verification

Contribution grade

Language-model inference systems · Human-designed research method or resource

Reference score65,000Provisional editorial estimate of this exact contribution; its grade is assessed separately.

What changed

Combined several boost-tuned small speculative models or heuristic proposals into token trees and verified shared-prefix candidates in one parallel target-model pass.

Scientific scope

Combined several boost-tuned small speculative models or heuristic proposals into token trees and verified shared-prefix candidates in one parallel target-model pass. Inherits speculative decoding, adaptive boosting and small-model distillation. Original verifier and selected LLaMA/OPT experiments do not certify every stochastic sampler or numerical implementation. Extra draft training, tree construction, verification compute and memory remain real costs.

Evidence

The linked original sources describe the stated contribution and its evidence limits. WRS has not independently rerun the experiments or certified a proof. Inherits speculative decoding, adaptive boosting and small-model distillation. Original verifier and selected LLaMA/OPT experiments do not certify every stochastic sampler or numerical implementation. Extra draft training, tree construction, verification compute and memory remain real costs.

Contributors

Provisional WRS assessment, edition 2026-10-16.1. Independent expert calibration is pending. This grade does not certify correctness or assign ownership.

Full scientific record · Browse contribution grades · Request a correction