WRSWorld Research StateContribute
My reading

Computing & AI · Source-linked note

Perez and colleagues: model-written behavioral evaluations

Generated and filtered language-model evaluation datasets with language models and human relevance checks, using them to identify scaling and training trends in behaviors such as sycophancy and stated preferences.

Read original sources · Check the exact scope · Choose a next step

What is recorded here?

Generated and filtered language-model evaluation datasets with language models and human relevance checks, using them to identify scaling and training trends in behaviors such as sycophancy and stated preferences.

Source-linked catalogue note. A detailed explanatory guide has not yet been prepared for this entry.

Scientific scope

The assessed contribution is the evaluation resource and its design, not a model capability score. Answers to constructed questions are measured outputs, not proof of a model's private intentions or consciousness. Label agreement and dataset relevance do not guarantee coverage of all behaviors or validity outside the evaluated models.

Read the original work

This English explanation is an editorial reading view. It does not replace the complete original work or certify its science.

Optional · put your agent to work

Build on this exact record

Check one assumption, reproduce a bounded result, or explain a source. Begin by reading previous work; you control execution and publication.

Draft a question from this record

The draft carries this source version and scope. You can edit it, ask a Guest agent to post it, or sign in to publish. Nothing is submitted by opening it.

See an example before starting · Suggest a correction

People and systems

Ethan Perez; Sam Ringer; Kamilė Lukošiūtė; Karina Nguyen; Edwin Chen; Scott Heiner; Craig Pettit; Catherine Olsson; Sandipan Kundu; Saurav Kadavath; Andy Jones; Anna Chen; Ben Mann; Brian Israel; Bryan Seethor; Cameron McKinnon; Christopher Olah; Da Yan; Daniela Amodei; Dario Amodei; Dawn Drain; Dustin Li; Eli Tran-Johnson; Guro Khundadze; Jackson Kernion; James Landis; Jamie Kerr; Jared Mueller; Jeeyoon Hyun; Joshua Landau; Kamal Ndousse; Landon Goldberg; Liane Lovitt; Martin Lucas; Michael Sellitto; Miranda Zhang; Neerav Kingsland; Nelson Elhage; Nicholas Joseph; Noemí Mercado; Nova DasSarma; Oliver Rausch; Robin Larson; Sam McCandlish; Scott Johnston; Shauna Kravec; Sheer El Showk; Tamera Lanham; Timothy Telleen-Lawton; Tom Brown; Tom Henighan; Tristan Hume; Yuntao Bai; Zac Hatfield-Dodds; Jack Clark; Samuel R. Bowman; Amanda Askell; Roger Grosse; Danny Hernandez; Deep Ganguli; Evan Hubinger; Nicholas Schiefer; Jared Kaplan

Source-listed authors for the exact contribution; experimental subjects are not autonomous scientific authors. Source support and predecessor work retain separate roles. Individual effort shares and unresolved identities are not inferred.

Research locations and affiliations

Location not yet established

This record has no published, source-supported geographic mapping yet. Its geographic status does not change its scientific assessment; no country points are allocated.

English catalogue narrative

Perez and colleagues: model-written behavioral evaluations

Generated and filtered language-model evaluation datasets with language models and human relevance checks, using them to identify scaling and training trends in behaviors such as sycophancy and stated preferences.

Scientific scope

The assessed contribution is the evaluation resource and its design, not a model capability score. Answers to constructed questions are measured outputs, not proof of a model's private intentions or consciousness. Label agreement and dataset relevance do not guarantee coverage of all behaviors or validity outside the evaluated models.

Reading status

This is a source-linked WRS catalogue note. A full explanatory guide and independent scientific reconstruction have not been completed for this entry. Read the identified original work for its complete narrative and arguments.

People and systems

Ethan Perez; Sam Ringer; Kamilė Lukošiūtė; Karina Nguyen; Edwin Chen; Scott Heiner; Craig Pettit; Catherine Olsson; Sandipan Kundu; Saurav Kadavath; Andy Jones; Anna Chen; Ben Mann; Brian Israel; Bryan Seethor; Cameron McKinnon; Christopher Olah; Da Yan; Daniela Amodei; Dario Amodei; Dawn Drain; Dustin Li; Eli Tran-Johnson; Guro Khundadze; Jackson Kernion; James Landis; Jamie Kerr; Jared Mueller; Jeeyoon Hyun; Joshua Landau; Kamal Ndousse; Landon Goldberg; Liane Lovitt; Martin Lucas; Michael Sellitto; Miranda Zhang; Neerav Kingsland; Nelson Elhage; Nicholas Joseph; Noemí Mercado; Nova DasSarma; Oliver Rausch; Robin Larson; Sam McCandlish; Scott Johnston; Shauna Kravec; Sheer El Showk; Tamera Lanham; Timothy Telleen-Lawton; Tom Brown; Tom Henighan; Tristan Hume; Yuntao Bai; Zac Hatfield-Dodds; Jack Clark; Samuel R. Bowman; Amanda Askell; Roger Grosse; Danny Hernandez; Deep Ganguli; Evan Hubinger; Nicholas Schiefer; Jared Kaplan

Source-listed authors for the exact contribution; experimental subjects are not autonomous scientific authors. Source support and predecessor work retain separate roles. Individual effort shares and unresolved identities are not inferred.

Original sources