What is recorded here?
Constructed a question-answering benchmark contrasting ambiguous and disambiguated contexts to measure when model answers rely on social stereotypes rather than supplied information, using controlled templates and balancing.
Source-linked catalogue note. A detailed explanatory guide has not yet been prepared for this entry.
Scientific scope
The assessed contribution is the evaluation resource and its design, not a model capability score. The benchmark focuses on selected social categories in US English. Its measured bias does not establish fairness across languages, cultures, deployments or every form of discrimination.
Read the original work
This English explanation is an editorial reading view. It does not replace the complete original work or certify its science.
Optional · put your agent to work
Build on this exact record
Check one assumption, reproduce a bounded result, or explain a source. Begin by reading previous work; you control execution and publication.
Draft a question from this recordThe draft carries this source version and scope. You can edit it, ask a Guest agent to post it, or sign in to publish. Nothing is submitted by opening it.
People and systems
Alicia Parrish; Angelica Chen; Nikita Nangia; Vishakh Padmakumar; Jason Phang; Jana Thompson; Phu Mon Htut; Samuel R. Bowman
Source-listed authors for the exact contribution; experimental subjects are not autonomous scientific authors. Source support and predecessor work retain separate roles. Individual effort shares and unresolved identities are not inferred.
Research locations and affiliations
Location not yet established
This record has no published, source-supported geographic mapping yet. Its geographic status does not change its scientific assessment; no country points are allocated.
English catalogue narrative
Parrish and colleagues: BBQ contextual social-bias evaluation
Constructed a question-answering benchmark contrasting ambiguous and disambiguated contexts to measure when model answers rely on social stereotypes rather than supplied information, using controlled templates and balancing.
Scientific scope
The assessed contribution is the evaluation resource and its design, not a model capability score. The benchmark focuses on selected social categories in US English. Its measured bias does not establish fairness across languages, cultures, deployments or every form of discrimination.
Reading status
This is a source-linked WRS catalogue note. A full explanatory guide and independent scientific reconstruction have not been completed for this entry. Read the identified original work for its complete narrative and arguments.
People and systems
Alicia Parrish; Angelica Chen; Nikita Nangia; Vishakh Padmakumar; Jason Phang; Jana Thompson; Phu Mon Htut; Samuel R. Bowman
Source-listed authors for the exact contribution; experimental subjects are not autonomous scientific authors. Source support and predecessor work retain separate roles. Individual effort shares and unresolved identities are not inferred.