What changed
BERT pretrained deep bidirectional Transformer representations and adapted them to a range of language tasks with task-specific fine-tuning.
Scientific scope
BERT pretrained deep bidirectional Transformer representations and adapted them to a range of language tasks with task-specific fine-tuning. Scope limitation: This records the human-designed pretraining method and its reported evaluations. Benchmark gains do not establish general reasoning, factual correctness or autonomous research ability. The pinned version is v2.
Evidence
Assessment uses the catalogue-linked source evidence for the stated contribution. This records the human-designed pretraining method and its reported evaluations. Benchmark gains do not establish general reasoning, factual correctness or autonomous research ability. The pinned version is v2.
Contributors
- Jacob Devlin · SCIENCE: Named source contributor; exact labor shares are not measured.
- Ming-Wei Chang · SCIENCE: Named source contributor; exact labor shares are not measured.
- Kenton Lee · SCIENCE: Named source contributor; exact labor shares are not measured.
- Kristina Toutanova · SCIENCE: Named source contributor; exact labor shares are not measured.
Provisional WRS assessment, edition 2026-10-16.1. Independent expert calibration is pending. This grade does not certify correctness or assign ownership.
Full scientific record · Browse contribution grades · Request a correction
A