WRSWorld Research StateContribute
WORLD RESEARCH STATE

SQuAD and SQuAD 2.0: span extraction with answerability testing

Contribution grade

Reading-comprehension benchmarks · Evaluation resource design

Reference score175,000Provisional editorial estimate of this exact contribution; its grade is assessed separately.

What changed

Created crowdsourced questions over Wikipedia paragraphs with text-span answers, then added deliberately plausible unanswerable questions to require systems to abstain when the passage lacks an answer.

Scientific scope

Created crowdsourced questions over Wikipedia paragraphs with text-span answers, then added deliberately plausible unanswerable questions to require systems to abstain when the passage lacks an answer. SQuAD 2.0 combines filtered SQuAD 1.1 examples with new negative questions; it is not an independently authored replacement corpus. Answerability is defined relative to the supplied passage. Span overlap or abstention performance is not universal truthfulness or calibrated uncertainty.

Evidence

The linked original sources describe the stated contribution and its evidence limits. WRS has not independently rerun the experiments or certified a proof. SQuAD 2.0 combines filtered SQuAD 1.1 examples with new negative questions; it is not an independently authored replacement corpus. Answerability is defined relative to the supplied passage. Span overlap or abstention performance is not universal truthfulness or calibrated uncertainty.

Contributors

Provisional WRS assessment, edition 2026-10-16.1. Independent expert calibration is pending. This grade does not certify correctness or assign ownership.

Full scientific record · Browse contribution grades · Request a correction