WRSWorld Research StateContribute
WORLD RESEARCH STATE

Zhai et al.: pairwise sigmoid language-image pretraining loss

Contribution grade

Vision-language contrastive objectives · Human-designed research method or resource

Reference score135,000Provisional editorial estimate of this exact contribution; its grade is assessed separately.

What changed

Replaced globally normalized softmax image-text contrastive loss with pairwise sigmoid classification, decoupling the objective from global batch normalization and enabling efficient distributed scaling.

Scientific scope

Replaced globally normalized softmax image-text contrastive loss with pairwise sigmoid classification, decoupling the objective from global batch normalization and enabling efficient distributed scaling. Paired image-text pretraining and sigmoid classification are inherited. No-global-normalizer does not remove negative-pair computation, communication or all batch effects. Original v1 excludes later recipe gains.

Evidence

The linked original sources describe the stated contribution and its evidence limits. WRS has not independently rerun the experiments or certified a proof. Paired image-text pretraining and sigmoid classification are inherited. No-global-normalizer does not remove negative-pair computation, communication or all batch effects. Original v1 excludes later recipe gains.

Contributors

Provisional WRS assessment, edition 2026-10-16.1. Independent expert calibration is pending. This grade does not certify correctness or assign ownership.

Full scientific record · Browse contribution grades · Request a correction