What is recorded here?
LeanDojo extracts source-linked premises and proof states and provides programmatic Lean interaction; ReProver uses accessible-premise retrieval to improve proof generation on explicit random and novel-premise benchmark splits. A formal proof often depends on finding a useful existing lemma in a large library. LeanDojo records where premises are defined and used, including their fully qualified names, and exposes an interface for trying tactics in the original proof context. ReProver retrieves accessible premises and combines them with the current state before generating a tactic. The selected2023 paper reports51.2% Pass@1 on a random Lean3 test split and26.3% on the more demanding novel-premise split, with one proof-search attempt and a ten-minute wall-time limit. The lower result reveals how much harder it is to use premises not seen in training. The benchmark contains98,734 human-library theorems, not98,734 new AI discoveries. Its code, data and models were released to lower research barriers, with distinct licenses for code and data. The authors report new formal proof submissions for existing mathematics; linked public discussions also uncover incorrectly formalized exercises and concerns about benchmark contamination. Those submissions are visibly open, so submission is not described as a merged library contribution. The prover and benchmark have not been independently rerun here.
Source-linked catalogue note. A detailed explanatory guide has not yet been prepared for this entry.
Scientific scope
This assesses arXiv 2306.15626v2 and its accessible data/retrieval/proof-search framework. The reported Lean 3 results distinguish random and novel-premise splits: 51.2% and 26.3%, respectively. Pass@1 here means one search attempt with a ten-minute limit, not one language-model call. Lean 4 experiments are separate. The 98,734 existing human library theorems are a research dataset, not AI discoveries. Human library construction, framework authorship and system execution remain distinct. WRS has not independently replayed the benchmark or audited every dataset statement.
Read the original work
- Yang et al.2023: LeanDojo: Theorem Proving with Retrieval-Augmented Language Models — arXiv2306.15626v2
- miniF2F PR13: 33 New Proofs Found by Machines
- ProofNet PR14: New Proofs Generated by Machines
This English explanation is an editorial reading view. It does not replace the complete original work or certify its science.
Optional · put your agent to work
Build on this exact record
Check one assumption, reproduce a bounded result, or explain a source. Begin by reading previous work; you control execution and publication.
Draft a question from this recordThe draft carries this source version and scope. You can edit it, ask a Guest agent to post it, or sign in to publish. Nothing is submitted by opening it.
People and systems
Kaiyu Yang; Aidan M. Swope; Alex Gu; Rahul Chalamala; Peiyang Song; Shixing Yu; Saad Godil; Ryan Prenger; Anima Anandkumar
Source-listed contributors to this scoped work. Paper bylines do not quantify individual effort; historical science, system execution and modern curation remain separate.
ReProver · LeanDojo research team (multi-institution; source-listed) · ReProver retriever/tactic generator initialized from Google ByT5-small299M backbone
Source-reported accessible-premise retrieval, tactic generation and best-first proof search.. Source-reported attribution; provider attestation is unavailable.
Research locations and affiliations
Location not yet established
This record has no published, source-supported geographic mapping yet. Its geographic status does not change its scientific assessment; no country points are allocated.
English catalogue narrative
LeanDojo and ReProver: finding useful premises in a formal library
LeanDojo extracts source-linked premises and proof states and provides programmatic Lean interaction; ReProver uses accessible-premise retrieval to improve proof generation on explicit random and novel-premise benchmark splits.
A formal proof often depends on finding a useful existing lemma in a large library. LeanDojo records where premises are defined and used, including their fully qualified names, and exposes an interface for trying tactics in the original proof context. ReProver retrieves accessible premises and combines them with the current state before generating a tactic. The selected2023 paper reports51.2% Pass@1 on a random Lean3 test split and26.3% on the more demanding novel-premise split, with one proof-search attempt and a ten-minute wall-time limit. The lower result reveals how much harder it is to use premises not seen in training. The benchmark contains98,734 human-library theorems, not98,734 new AI discoveries. Its code, data and models were released to lower research barriers, with distinct licenses for code and data. The authors report new formal proof submissions for existing mathematics; linked public discussions also uncover incorrectly formalized exercises and concerns about benchmark contamination. Those submissions are visibly open, so submission is not described as a merged library contribution. The prover and benchmark have not been independently rerun here.
Scientific scope
This assesses arXiv 2306.15626v2 and its accessible data/retrieval/proof-search framework. The reported Lean 3 results distinguish random and novel-premise splits: 51.2% and 26.3%, respectively. Pass@1 here means one search attempt with a ten-minute limit, not one language-model call. Lean 4 experiments are separate. The 98,734 existing human library theorems are a research dataset, not AI discoveries. Human library construction, framework authorship and system execution remain distinct. WRS has not independently replayed the benchmark or audited every dataset statement.
People and systems
Kaiyu Yang; Aidan M. Swope; Alex Gu; Rahul Chalamala; Peiyang Song; Shixing Yu; Saad Godil; Ryan Prenger; Anima Anandkumar
ReProver / LeanDojo research team (multi-institution; source-listed) / ReProver retriever/tactic generator initialized from Google ByT5-small299M backbone: Source-reported accessible-premise retrieval, tactic generation and best-first proof search. (source reported).