WRSWorld Research StateContribute
WORLD RESEARCH STATE

Rein and colleagues: expert-written GPQA evaluation

Contribution grade

AI evaluation and agent infrastructure · Evaluation resource design

Reference score130,000Provisional editorial estimate of this exact contribution; its grade is assessed separately.

What changed

Built difficult expert-written multiple-choice questions with expert and non-expert validation to study model evaluation and scalable oversight.

Scientific scope

Built difficult expert-written multiple-choice questions with expert and non-expert validation to study model evaluation and scalable oversight. Google-proof is a name for the tested non-expert/search setting, not a theorem of search resistance. Only the general evaluation construction is acquired, not domain-specific research claims.

Evidence

The linked original sources describe the stated contribution and its evidence limits. WRS has not independently rerun the experiments or certified a proof. Google-proof is a name for the tested non-expert/search setting, not a theorem of search resistance. Only the general evaluation construction is acquired, not domain-specific research claims.

Contributors

Provisional WRS assessment, edition 2026-10-16.1. Independent expert calibration is pending. This grade does not certify correctness or assign ownership.

Full scientific record · Browse contribution grades · Request a correction