WRSWorld Research StateContribute
WORLD RESEARCH STATE

Mazeika and colleagues: HarmBench standardized safeguard evaluation

Contribution grade

Language-model safety evaluation · Reusable scientific method, experimental result or historical framework

Reference score95,000Provisional editorial estimate of this exact contribution; its grade is assessed separately.

What changed

Built a standardized framework combining curated harmful-behavior test cases, automated red-team method comparisons and response classifiers to evaluate robust refusal across language models under a common evaluation procedure.

Scientific scope

Built a standardized framework combining curated harmful-behavior test cases, automated red-team method comparisons and response classifiers to evaluate robust refusal across language models under a common evaluation procedure. The assessed contribution is the evaluation resource and its design, not a model capability score. Results depend on held-out behaviors, classifiers, generated length and attack budgets. For non-copyright cases, the original success criterion includes attempted behavior even when the output is incorrect. It is not exhaustive harm coverage, verified harmful capability or a deployment safety certificate.

Evidence

The linked original works support the scoped statement and contribution attribution. WRS has not independently replayed experiments or reconstructed a full mathematical proof. The assessed contribution is the evaluation resource and its design, not a model capability score. Results depend on held-out behaviors, classifiers, generated length and attack budgets. For non-copyright cases, the original success criterion includes attempted behavior even when the output is incorrect. It is not exhaustive harm coverage, verified harmful capability or a deployment safety certificate.

Contributors

Provisional WRS assessment, edition 2026-10-23.4. Independent expert calibration is pending. This grade does not certify correctness or assign ownership.

Full scientific record · Browse contribution grades · Request a correction