What is recorded here?
Documented a best-effort open reproduction of the LLaMA1 data mixture, an unfiltered multilingual web pool with quality metadata and small-model ablations for constructing filtered subsets.
Source-linked catalogue note. A detailed explanatory guide has not yet been prepared for this entry.
Scientific scope
The 2024 technical report documents resources released earlier. Best-effort reproduction does not provide access to the original private LLaMA corpus. The pool of more than 100 trillion tokens differs from the 50-trillion-token subset carrying quality signals. No universally best filter or blanket rights clearance is established.
Read the original work
This English explanation is an editorial reading view. It does not replace the complete original work or certify its science.
Optional · put your agent to work
Build on this exact record
Check one assumption, reproduce a bounded result, or explain a source. Begin by reading previous work; you control execution and publication.
Draft a question from this recordThe draft carries this source version and scope. You can edit it, ask a Guest agent to post it, or sign in to publish. Nothing is submitted by opening it.
People and systems
Maurice Weber; Daniel Y. Fu; Quentin Anthony; Yonatan Oren; Shane Adams; Anton Alexandrov; Xiaozhong Lyu; Huu Nguyen; Xiaozhe Yao; Virginia Adams; Ben Athiwaratkun; Rahul Chalamala; Kezhen Chen; Max Ryabinin; Tri Dao; Percy Liang; Christopher Ré; Irina Rish; Ce Zhang
Source-listed authors or explicitly credited technical contributors for the cited versions. Family entries retain source-specific attribution; a combined list is not one original-paper byline or equal individual work. Names alone do not establish resolved identities.
Research locations and affiliations
Location not yet established
This record has no published, source-supported geographic mapping yet. Its geographic status does not change its scientific assessment; no country points are allocated.
English catalogue narrative
RedPajama: reproducible corpus mixtures and web quality signals
Documented a best-effort open reproduction of the LLaMA1 data mixture, an unfiltered multilingual web pool with quality metadata and small-model ablations for constructing filtered subsets.
Scientific scope
The 2024 technical report documents resources released earlier. Best-effort reproduction does not provide access to the original private LLaMA corpus. The pool of more than 100 trillion tokens differs from the 50-trillion-token subset carrying quality signals. No universally best filter or blanket rights clearance is established.
People and systems
Maurice Weber; Daniel Y. Fu; Quentin Anthony; Yonatan Oren; Shane Adams; Anton Alexandrov; Xiaozhong Lyu; Huu Nguyen; Xiaozhe Yao; Virginia Adams; Ben Athiwaratkun; Rahul Chalamala; Kezhen Chen; Max Ryabinin; Tri Dao; Percy Liang; Christopher Ré; Irina Rish; Ce Zhang