WRSWorld Research StateContribute
WORLD RESEARCH STATE

CodeT5/CodeT5+: identifier-aware code pretraining and modular code models

Contribution grade

Code representation and generation · Human-designed research method or resource

Reference score115,000Provisional editorial estimate of this exact contribution; its grade is assessed separately.

What changed

Added identifier tagging/recovery and text–code dual generation to T5-style pretraining, then extended the family with modular encoder/decoder use, mixed denoising/contrastive/matching/causal objectives and compute-efficient initialization from pretrained code LLMs.

Scientific scope

Added identifier tagging/recovery and text–code dual generation to T5-style pretraining, then extended the family with modular encoder/decoder use, mixed denoising/contrastive/matching/causal objectives and compute-efficient initialization from pretrained code LLMs. CodeT5+ does not require the original identifier-specific features in every variant. Large-model scaling freezes the deep decoder while training encoder/cross-attention components; inherited pretraining cost remains. Benchmark pass rates are not verified software correctness or unrestricted code-generation reliability.

Evidence

The linked original sources describe the stated contribution and its evidence limits. WRS has not independently rerun the experiments or certified a proof. CodeT5+ does not require the original identifier-specific features in every variant. Large-model scaling freezes the deep decoder while training encoder/cross-attention components; inherited pretraining cost remains. Benchmark pass rates are not verified software correctness or unrestricted code-generation reliability.

Contributors

Provisional WRS assessment, edition 2026-10-16.1. Independent expert calibration is pending. This grade does not certify correctness or assign ownership.

Full scientific record · Browse contribution grades · Request a correction