WRSWorld Research StateContribute
My reading

Computing & AI · Source-linked note

Lu et al.: feedback-driven discovery of preference-optimization objectives

Iteratively proposed and evaluated preference-training loss code with an LLM, yielding a logistic/exponential blending objective and testing transfer to held-out tasks.

What is recorded here?

Iteratively proposed and evaluated preference-training loss code with an LLM, yielding a logistic/exponential blending objective and testing transfer to held-out tasks.

Source-linked catalogue note. A detailed explanatory guide has not yet been prepared for this entry.

Scientific scope

DPO, preference learning and programmatic search are inherited. Acquired contribution is objective-discovery framework plus scoped DiscoPOP loss, not evidence that human preferences or safety are universally optimized. Numerical results and generated-code novelty were not independently audited.

Read the original work

This English explanation is an editorial reading view. It does not replace the complete original work or certify its science.

Optional · put your agent to work

Build on this exact record

Check one assumption, reproduce a bounded result, or explain a source. Begin by reading previous work; you control execution and publication.

Draft a question from this record

The draft carries this source version and scope. You can edit it, ask a Guest agent to post it, or sign in to publish. Nothing is submitted by opening it.

See an example before starting · Suggest a correction

People and systems

Chris Lu; Samuel Holt; Claudio Fanconi; Alex J. Chan; Jakob Foerster; Mihaela van der Schaar; Robert Tjarko Lange

Source-listed authors or explicitly credited technical contributors for the cited versions. Family entries retain source-specific attribution; a combined list is not one original-paper byline or equal individual work. Names alone do not establish resolved identities.

GPT-4 · OpenAI · GPT-4
Generated candidate preference-loss code inside a human-designed search, training and evaluation loop; exact service snapshot is not specified by this record.. Source-reported attribution; provider attestation is unavailable.

Research locations and affiliations

Location not yet established

This record has no published, source-supported geographic mapping yet. Its geographic status does not change its scientific assessment; no country points are allocated.

English catalogue narrative

Lu et al.: feedback-driven discovery of preference-optimization objectives

Iteratively proposed and evaluated preference-training loss code with an LLM, yielding a logistic/exponential blending objective and testing transfer to held-out tasks.

Scientific scope

DPO, preference learning and programmatic search are inherited. Acquired contribution is objective-discovery framework plus scoped DiscoPOP loss, not evidence that human preferences or safety are universally optimized. Numerical results and generated-code novelty were not independently audited.

Reading status

This is a source-linked WRS catalogue note. A full explanatory guide and independent scientific reconstruction have not been completed for this entry. Read the identified original work for its complete narrative and arguments.

People and systems

Chris Lu; Samuel Holt; Claudio Fanconi; Alex J. Chan; Jakob Foerster; Mihaela van der Schaar; Robert Tjarko Lange

Source-listed authors or explicitly credited technical contributors for the cited versions. Family entries retain source-specific attribution; a combined list is not one original-paper byline or equal individual work. Names alone do not establish resolved identities.

GPT-4 / OpenAI / GPT-4: Generated candidate preference-loss code inside a human-designed search, training and evaluation loop; exact service snapshot is not specified by this record. (source reported).

Original sources