WRSWorld Research StateContribute
WORLD RESEARCH STATE

Gehman and colleagues: RealToxicityPrompts degeneration benchmark

Contribution grade

Language-model safety evaluation · Reusable scientific method, experimental result or historical framework

Reference score65,000Provisional editorial estimate of this exact contribution; its grade is assessed separately.

What changed

Built a stratified collection of web-text prompts and evaluated how language-model continuations receive toxicity scores, testing how prompting context and existing mitigation approaches affect toxic generation.

Scientific scope

Built a stratified collection of web-text prompts and evaluated how language-model continuations receive toxicity scores, testing how prompting context and existing mitigation approaches affect toxic generation. The assessed contribution is the evaluation resource and its design, not a model capability score. The sampling design is not a natural-prevalence estimate. Toxicity scores inherit classifier biases and threshold choices; a low score does not establish absence of all harms or effectiveness for every population.

Evidence

The linked original works support the scoped statement and contribution attribution. WRS has not independently replayed experiments or reconstructed a full mathematical proof. The assessed contribution is the evaluation resource and its design, not a model capability score. The sampling design is not a natural-prevalence estimate. Toxicity scores inherit classifier biases and threshold choices; a low score does not establish absence of all harms or effectiveness for every population.

Contributors

Provisional WRS assessment, edition 2026-10-23.4. Independent expert calibration is pending. This grade does not certify correctness or assign ownership.

Full scientific record · Browse contribution grades · Request a correction