BWhat changed
Used evolutionary program search, selection and simplification to discover Lion, a momentum-based sign-update optimizer, and evaluated its transfer from proxy tasks to larger vision and language training.
Scientific scope
Used evolutionary program search, selection and simplification to discover Lion, a momentum-based sign-update optimizer, and evaluated its transfer from proxy tasks to larger vision and language training. Evolutionary search generated candidate optimizer programs. Human researchers designed the search and evaluation, selected candidates and simplified the final optimizer. The human-designed evolutionary search, selection procedure and resulting optimizer are assessed together. Gains vary with learning rate, batch size and task; the paper identifies settings with small or insignificant improvements. Program search is not proof of universal optimizer superiority or autonomous scientific correctness.
Evidence
Evolutionary search generated candidate optimizer programs. Human researchers designed the search and evaluation, selected candidates and simplified the final optimizer. WRS has not independently rerun these experiments. Evolutionary search generated candidate optimizer programs. Human researchers designed the search and evaluation, selected candidates and simplified the final optimizer. The human-designed evolutionary search, selection procedure and resulting optimizer are assessed together. Gains vary with learning rate, batch size and task; the paper identifies settings with small or insignificant improvements. Program search is not proof of universal optimizer superiority or autonomous scientific correctness.
Contributors
- Source-listed authors and technical contributors · SCIENCE: Source-listed authors or explicitly credited technical contributors for the cited versions. Family entries retain source-specific attribution; a combined list is not one original-paper byline or equal individual work. Names alone do not establish resolved identities.
- Symbolic Discovery of Optimization Algorithms
- Chen et al.: symbolic optimizer search and Lion — author/proceedings record
Provisional WRS assessment, edition 2026-10-16.1. Independent expert calibration is pending. This grade does not certify correctness or assign ownership.
Full scientific record · Browse contribution grades · Request a correction