BWhat changed
Combined a jailbreak-response judgment benchmark with multi-agent explanation and aggregation, and distilled judgment behavior into an open evaluation model for comparing model safeguards.
Scientific scope
Combined a jailbreak-response judgment benchmark with multi-agent explanation and aggregation, and distilled judgment behavior into an open evaluation model for comparing model safeguards. The assessed contribution is the evaluation resource and its design, not a model capability score. Related models can make correlated judgment errors; majority agreement and evidence aggregation do not create independent ground truth. Counts and categories vary within the original version. Removing API calls does not remove local inference costs. Judge accuracy is not universal scientific or factual correctness.
Evidence
The linked original works support the scoped statement and contribution attribution. WRS has not independently replayed experiments or reconstructed a full mathematical proof. The assessed contribution is the evaluation resource and its design, not a model capability score. Related models can make correlated judgment errors; majority agreement and evidence aggregation do not create independent ground truth. Counts and categories vary within the original version. Removing API calls does not remove local inference costs. Judge accuracy is not universal scientific or factual correctness.
Contributors
- The named authors in the research record · SCIENCE: Source-listed authors for the exact contribution; experimental subjects are not autonomous scientific authors. Source support and predecessor work retain separate roles. Individual effort shares and unresolved identities are not inferred.
Provisional WRS assessment, edition 2026-10-23.4. Independent expert calibration is pending. This grade does not certify correctness or assign ownership.
Full scientific record · Browse contribution grades · Request a correction