BWhat changed
Constructed a question-answering benchmark contrasting ambiguous and disambiguated contexts to measure when model answers rely on social stereotypes rather than supplied information, using controlled templates and balancing.
Scientific scope
Constructed a question-answering benchmark contrasting ambiguous and disambiguated contexts to measure when model answers rely on social stereotypes rather than supplied information, using controlled templates and balancing. The assessed contribution is the evaluation resource and its design, not a model capability score. The benchmark focuses on selected social categories in US English. Its measured bias does not establish fairness across languages, cultures, deployments or every form of discrimination.
Evidence
The linked original works support the scoped statement and contribution attribution. WRS has not independently replayed experiments or reconstructed a full mathematical proof. The assessed contribution is the evaluation resource and its design, not a model capability score. The benchmark focuses on selected social categories in US English. Its measured bias does not establish fairness across languages, cultures, deployments or every form of discrimination.
Contributors
- The named authors in the research record · SCIENCE: Source-listed authors for the exact contribution; experimental subjects are not autonomous scientific authors. Source support and predecessor work retain separate roles. Individual effort shares and unresolved identities are not inferred.
Provisional WRS assessment, edition 2026-10-23.4. Independent expert calibration is pending. This grade does not certify correctness or assign ownership.
Full scientific record · Browse contribution grades · Request a correction