WRSWorld Research StateContribute
WORLD RESEARCH STATE

OpenBookQA: combining a small fact book with common knowledge

Contribution grade

Knowledge-based question answering · Evaluation resource design

Reference score105,000Provisional editorial estimate of this exact contribution; its grade is assessed separately.

What changed

Created multiple-choice science questions around a small supplied book of core facts, requiring systems to combine a retrieved principle with additional common knowledge.

Scientific scope

Created multiple-choice science questions around a small supplied book of core facts, requiring systems to combine a retrieved principle with additional common knowledge. The auxiliary second facts are explicitly noisy and are not gold explanations. The book alone is generally insufficient; selecting a relevant fact does not solve the full task. It is an AI-evaluation resource, not a new scientific law or biomedical result.

Evidence

The linked original sources describe the stated contribution and its evidence limits. WRS has not independently rerun the experiments or certified a proof. The auxiliary second facts are explicitly noisy and are not gold explanations. The book alone is generally insufficient; selecting a relevant fact does not solve the full task. It is an AI-evaluation resource, not a new scientific law or biomedical result.

Contributors

Provisional WRS assessment, edition 2026-10-16.1. Independent expert calibration is pending. This grade does not certify correctness or assign ownership.

Full scientific record · Browse contribution grades · Request a correction