What is claimed?
Adapted gated bigram/trigram lookup features into multiple attention-value layers with decorrelated layer-specific hashes, combining them with training and architecture choices for fixed-budget small-language-model training. Reported result; not independently verified by WRS. Ranked using a provisional grade and reference estimate for the exact claimed result.
Scientific scope
Ten-seed five-minute single-B200 tests, not a large-model scaling guarantee or proof of independent rediscovery. Hash embeddings, Muon and baseline nanochat components are inherited. Search initially used H100; hardware transfer and repeated benchmark feedback constrain comparisons. No training or no-leakage audit was replayed.
Evidence state
The source reports this result. WRS has not independently reconstructed the complete argument or validated the reported evidence. The grade and score here express conditional significance; they do not certify correctness. The provisional value enters the main reference rankings with an unverified label, but not achieved-science progress totals.
- Recursive original nanochat_autoresearch artifact documentation
- First Steps Toward Automated AI Research
Full scientific record · Challenge or correct this assessment
C