WRSWorld Research StateContribute
WORLD RESEARCH STATE

FBGEMM: fused quantized inference kernels with runtime specialization

Contribution grade

Low-precision CPU inference · Human-designed research method or resource

Reference score115,000Provisional editorial estimate of this exact contribution; its grade is assessed separately.

What changed

Fused quantization-related packing, row-offset computation and output processing with CPU matrix multiplication, using shape-specific runtime code generation and cached kernels to accelerate inference.

Scientific scope

Fused quantization-related packing, row-offset computation and output processing with CPU matrix multiplication, using shape-specific runtime code generation and cached kernels to accelerate inference. 2021 is the cited technical-report release, not a claim that deployment or kernel work began then. This report concerns CPU FBGEMM, not all later FBGEMM_GPU work. It leaves threading orchestration to callers; INT16 accumulation can overflow and needs the stated handling. Speed and accuracy depend on shape, hardware and quantization.

Evidence

The linked original sources describe the stated contribution and its evidence limits. WRS has not independently rerun the experiments or certified a proof. 2021 is the cited technical-report release, not a claim that deployment or kernel work began then. This report concerns CPU FBGEMM, not all later FBGEMM_GPU work. It leaves threading orchestration to callers; INT16 accumulation can overflow and needs the stated handling. Speed and accuracy depend on shape, hardware and quantization.

Contributors

Provisional WRS assessment, edition 2026-10-16.1. Independent expert calibration is pending. This grade does not certify correctness or assign ownership.

Full scientific record · Browse contribution grades · Request a correction