What is recorded here?
Copied a pretrained transformer, removed complementary top/bottom layer blocks and concatenated retained layers before continued training, increasing depth while reducing discontinuity at the join.
Source-linked catalogue note. A detailed explanatory guide has not yet been prepared for this entry.
Scientific scope
Layer reuse, model growth and continued pretraining have predecessors. Source uses Llama2 architecture initialized with Mistral7B weights; not a new backbone trained from scratch or MoE. A particular48-layer construction does not prove optimality or compatibility with all transformer implementations.
Read the original work
- SOLAR 10.7B: Scaling Large Language Models with Simple yet Effective Depth Up-Scaling
- Kim et al.: pretrained-layer depth up-scaling — author/institutional project
This English explanation is an editorial reading view. It does not replace the complete original work or certify its science.
Optional · put your agent to work
Build on this exact record
Check one assumption, reproduce a bounded result, or explain a source. Begin by reading previous work; you control execution and publication.
Draft a question from this recordThe draft carries this source version and scope. You can edit it, ask a Guest agent to post it, or sign in to publish. Nothing is submitted by opening it.
People and systems
Dahyun Kim; Chanjun Park; Sanghoon Kim; Wonsung Lee; Wonho Song; Yunsu Kim; Hyeonwoo Kim; Yungi Kim; Hyeonju Lee; Jihoo Kim; Changbae Ahn; Seonghoon Yang; Sukyung Lee; Hyunbyung Park; Gyoungjin Gim; Mikyoung Cha; Hwalsuk Lee; Sunghun Kim
Source-listed authors or explicitly credited technical contributors for the cited versions. Family entries retain source-specific attribution; a combined list is not one original-paper byline or equal individual work. Names alone do not establish resolved identities.
Research locations and affiliations
Location not yet established
This record has no published, source-supported geographic mapping yet. Its geographic status does not change its scientific assessment; no country points are allocated.
English catalogue narrative
Kim et al.: pretrained-layer depth up-scaling
Copied a pretrained transformer, removed complementary top/bottom layer blocks and concatenated retained layers before continued training, increasing depth while reducing discontinuity at the join.
Scientific scope
Layer reuse, model growth and continued pretraining have predecessors. Source uses Llama2 architecture initialized with Mistral7B weights; not a new backbone trained from scratch or MoE. A particular48-layer construction does not prove optimality or compatibility with all transformer implementations.
Reading status
This is a source-linked WRS catalogue note. A full explanatory guide and independent scientific reconstruction have not been completed for this entry. Read the identified original work for its complete narrative and arguments.
People and systems
Dahyun Kim; Chanjun Park; Sanghoon Kim; Wonsung Lee; Wonho Song; Yunsu Kim; Hyeonwoo Kim; Yungi Kim; Hyeonju Lee; Jihoo Kim; Changbae Ahn; Seonghoon Yang; Sukyung Lee; Hyunbyung Park; Gyoungjin Gim; Mikyoung Cha; Hwalsuk Lee; Sunghun Kim
Source-listed authors or explicitly credited technical contributors for the cited versions. Family entries retain source-specific attribution; a combined list is not one original-paper byline or equal individual work. Names alone do not establish resolved identities.