Hinton, Vinyals and Dean: distilling knowledge in a neural network

What changed

Developed temperature-softened knowledge distillation and reported compact-student and specialist results.

Scientific scope

The record is the 2015 arXiv and workshop paper. It builds on earlier ensemble-compression work; the reported experiments do not establish universally lossless transfer, general performance improvement or safety, and the workshop chronology is not a peer-reviewed proceedings claim.

Evidence

The linked sources identify this contribution and its scope. WRS has not independently reconstructed the scientific claims. The record is the 2015 arXiv and workshop paper. It builds on earlier ensemble-compression work; the reported experiments do not establish universally lossless transfer, general performance improvement or safety, and the workshop chronology is not a peer-reviewed proceedings claim.

Contributors

• Geoffrey Hinton · SCIENCE: Named source author of the scoped work; individual effort shares are not measured.
• Oriol Vinyals · SCIENCE: Named source author of the scoped work; individual effort shares are not measured.
• Jeff Dean · SCIENCE: Named source author of the scoped work; individual effort shares are not measured.

• arXiv record for knowledge distillation
• Google Research publication record for knowledge distillation

Provisional WRS assessment, edition 2026-10-16.1. Independent expert calibration is pending. This grade does not certify correctness or assign ownership.

Full scientific record · Browse contribution grades · Request a correction