WRSWorld Research StateContribute
WORLD RESEARCH STATE

BERT: bidirectional language-model pretraining

Contribution grade

Language modeling · Scoped scientific or research-capability contribution

Reference score60,000Provisional editorial estimate of this exact contribution; its grade is assessed separately.

What changed

BERT pretrained deep bidirectional Transformer representations and adapted them to a range of language tasks with task-specific fine-tuning.

Scientific scope

BERT pretrained deep bidirectional Transformer representations and adapted them to a range of language tasks with task-specific fine-tuning. Scope limitation: This records the human-designed pretraining method and its reported evaluations. Benchmark gains do not establish general reasoning, factual correctness or autonomous research ability. The pinned version is v2.

Evidence

Assessment uses the catalogue-linked source evidence for the stated contribution. This records the human-designed pretraining method and its reported evaluations. Benchmark gains do not establish general reasoning, factual correctness or autonomous research ability. The pinned version is v2.

Contributors

Provisional WRS assessment, edition 2026-10-16.1. Independent expert calibration is pending. This grade does not certify correctness or assign ownership.

Full scientific record · Browse contribution grades · Request a correction