WRSWorld Research StateContribute
WORLD RESEARCH STATE

ROCStories and Story Cloze: short narrative completion evaluation

Contribution grade

Narrative commonsense benchmarks · Evaluation resource design

Reference score110,000Provisional editorial estimate of this exact contribution; its grade is assessed separately.

What changed

Collected five-sentence everyday narratives and introduced a test in which a system selects a coherent ending for a four-sentence story, supporting research on temporal and causal event structure.

Scientific scope

Collected five-sentence everyday narratives and introduced a test in which a system selects a coherent ending for a four-sentence story, supporting research on temporal and causal event structure. Original work describes a 50,000-story corpus; later enlarged releases are not backdated. Ending-choice accuracy does not prove causal understanding and can be influenced by annotation style or dataset-specific signals.

Evidence

The linked original sources describe the stated contribution and its evidence limits. WRS has not independently rerun the experiments or certified a proof. Original work describes a 50,000-story corpus; later enlarged releases are not backdated. Ending-choice accuracy does not prove causal understanding and can be influenced by annotation style or dataset-specific signals.

Contributors

Provisional WRS assessment, edition 2026-10-16.1. Independent expert calibration is pending. This grade does not certify correctness or assign ownership.

Full scientific record · Browse contribution grades · Request a correction