WRSWorld Research StateContribute
WORLD RESEARCH STATE

Wang et al.: BEiT-3 multiway vision-language pretraining

Contribution grade

Unified visual and vision-language pretraining · Human-designed research method or resource

Reference score115,000Provisional editorial estimate of this exact contribution; its grade is assessed separately.

What changed

Introduced multiway Transformer blocks and a shared masked-modeling objective across images, text and paired modalities, supporting deep fusion and modality-specific encoding.

Scientific scope

Introduced multiway Transformer blocks and a shared masked-modeling objective across images, text and paired modalities, supporting deep fusion and modality-specific encoding. Technical delta is the modular multiway backbone and unified multimodal objective, not a separate count for scale or each downstream benchmark. Task-transfer results are empirical and configuration-specific.

Evidence

The linked original sources describe the stated contribution and its evidence limits. WRS has not independently rerun the experiments or certified a proof. Technical delta is the modular multiway backbone and unified multimodal objective, not a separate count for scale or each downstream benchmark. Task-transfer results are empirical and configuration-specific.

Contributors

Provisional WRS assessment, edition 2026-10-16.1. Independent expert calibration is pending. This grade does not certify correctness or assign ownership.

Full scientific record · Browse contribution grades · Request a correction