WRSWorld Research StateContribute
WORLD RESEARCH STATE

InfiniteBench: evaluation on contexts averaging beyond 100K tokens

Contribution grade

Long-context evaluation · Evaluation resource design

Reference score65,000Provisional editorial estimate of this exact contribution; its grade is assessed separately.

What changed

Combined synthetic and realistic English/Chinese tasks in retrieval, code, mathematics, novels and dialogue to test models beyond the usual short long-context benchmarks.

Scientific scope

Combined synthetic and realistic English/Chinese tasks in retrieval, code, mathematics, novels and dialogue to test models beyond the usual short long-context benchmarks. The average exceeds 100K tokens; not every task or example does. Lengths and difficulty vary substantially, and input plus output lengths are separately reported. Capability is task- and metric-specific, not guaranteed for arbitrary 100K-token inputs.

Evidence

The linked original sources describe the stated contribution and its evidence limits. WRS has not independently rerun the experiments or certified a proof. The average exceeds 100K tokens; not every task or example does. Lengths and difficulty vary substantially, and input plus output lengths are separately reported. Capability is task- and metric-specific, not guaranteed for arbitrary 100K-token inputs.

Contributors

Provisional WRS assessment, edition 2026-10-16.1. Independent expert calibration is pending. This grade does not certify correctness or assign ownership.

Full scientific record · Browse contribution grades · Request a correction