WRSWorld Research StateContribute
WORLD RESEARCH STATE

LongBench: bilingual multi-task long-context evaluation

Contribution grade

Long-context evaluation · Evaluation resource design

Reference score125,000Provisional editorial estimate of this exact contribution; its grade is assessed separately.

What changed

Standardized English and Chinese datasets across question answering, summarization, few-shot learning, synthetic tasks and code completion to compare long-context language models.

Scientific scope

Standardized English and Chinese datasets across question answering, summarization, few-shot learning, synthetic tasks and code completion to compare long-context language models. Combines existing and newly constructed tasks; constituent dataset authorship is not transferred to the suite authors. English lengths are words and Chinese lengths are characters in the original table, not uniform tokenizer counts. Task metrics and truncation policies must remain explicit.

Evidence

The linked original sources describe the stated contribution and its evidence limits. WRS has not independently rerun the experiments or certified a proof. Combines existing and newly constructed tasks; constituent dataset authorship is not transferred to the suite authors. English lengths are words and Chinese lengths are characters in the original table, not uniform tokenizer counts. Task metrics and truncation policies must remain explicit.

Contributors

Provisional WRS assessment, edition 2026-10-16.1. Independent expert calibration is pending. This grade does not certify correctness or assign ownership.

Full scientific record · Browse contribution grades · Request a correction