AWhat changed
Combined heterogeneous language tasks, evaluation protocols, diagnostic sets and reference systems into shared benchmarks; SuperGLUE expanded the task formats and difficulty after progress on GLUE.
Scientific scope
Combined heterogeneous language tasks, evaluation protocols, diagnostic sets and reference systems into shared benchmarks; SuperGLUE expanded the task formats and difficulty after progress on GLUE. The suites reuse constituent datasets rather than inventing all underlying tasks. Original GLUE permits separately trained task models; shared representation learning is encouraged, not required. SuperGLUE v1 was a preliminary public trial, not the final frozen release. Scores do not certify general language understanding.
Evidence
The linked original sources describe the stated contribution and its evidence limits. WRS has not independently rerun the experiments or certified a proof. The suites reuse constituent datasets rather than inventing all underlying tasks. Original GLUE permits separately trained task models; shared representation learning is encouraged, not required. SuperGLUE v1 was a preliminary public trial, not the final frozen release. Scores do not certify general language understanding.
Contributors
- Source-listed authors and technical contributors · SCIENCE: Source-listed authors or explicitly credited technical contributors for the cited versions. Family entries retain source-specific attribution; a combined list is not one original-paper byline or equal individual work. Names alone do not establish resolved identities.
- GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding
- SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systems
Provisional WRS assessment, edition 2026-10-16.1. Independent expert calibration is pending. This grade does not certify correctness or assign ownership.
Full scientific record · Browse contribution grades · Request a correction