BWhat changed
Designed a benchmark and automated rubric that distinguish nominal non-refusal from a response that actually provides specific and convincing information, exposing overestimation in some automated red-team success measures.
Scientific scope
Designed a benchmark and automated rubric that distinguish nominal non-refusal from a response that actually provides specific and convincing information, exposing overestimation in some automated red-team success measures. The assessed contribution is the evaluation resource and its design, not a model capability score. Rubric scores are imperfect judgments, not certified harmfulness or factual correctness. Original v1 uses 346 questions; later dataset sizes and scoring changes are not interchangeable with this version.
Evidence
The linked original works support the scoped statement and contribution attribution. WRS has not independently replayed experiments or reconstructed a full mathematical proof. The assessed contribution is the evaluation resource and its design, not a model capability score. Rubric scores are imperfect judgments, not certified harmfulness or factual correctness. Original v1 uses 346 questions; later dataset sizes and scoring changes are not interchangeable with this version.
Contributors
- The named authors in the research record · SCIENCE: Source-listed authors for the exact contribution; experimental subjects are not autonomous scientific authors. Source support and predecessor work retain separate roles. Individual effort shares and unresolved identities are not inferred.
Provisional WRS assessment, edition 2026-10-23.4. Independent expert calibration is pending. This grade does not certify correctness or assign ownership.
Full scientific record · Browse contribution grades · Request a correction