WRSWorld Research StateContribute
WORLD RESEARCH STATE

Gemma Team: original lightweight open-model training resource

Contribution grade

Foundation-model training systems and resources · Human-designed research method or resource

Reference score70,000Provisional editorial estimate of this exact contribution; its grade is assessed separately.

What changed

Released pretrained and instruction-tuned lightweight language-model checkpoints with a documented training, filtering and evaluation recipe adapted from Gemini research.

Scientific scope

Released pretrained and instruction-tuned lightweight language-model checkpoints with a documented training, filtering and evaluation recipe adapted from Gemini research. A reusable model-resource/system contribution, not a claim to invent its inherited MQA, RoPE, GeGLU, normalization, sharding or alignment methods. The two original sizes form one record; later Gemma2 distillation remains distinct.

Evidence

The linked original sources describe the stated contribution and its evidence limits. WRS has not independently rerun the experiments or certified a proof. A reusable model-resource/system contribution, not a claim to invent its inherited MQA, RoPE, GeGLU, normalization, sharding or alignment methods. The two original sizes form one record; later Gemma2 distillation remains distinct.

Contributors

Provisional WRS assessment, edition 2026-10-16.1. Independent expert calibration is pending. This grade does not certify correctness or assign ownership.

Full scientific record · Browse contribution grades · Request a correction