WRSWorld Research StateContribute
WORLD RESEARCH STATE

Microsoft: Phi-3 data-curated compact language-model system

Contribution grade

Language-model training and open research resources · Human-designed research method or resource

Reference score70,000Provisional editorial estimate of this exact contribution; its grade is assessed separately.

What changed

Scaled filtered web and synthetic training data to produce compact general-purpose language models with on-device deployment experiments and documented post-training.

Scientific scope

Scaled filtered web and synthetic training data to produce compact general-purpose language models with on-device deployment experiments and documented post-training. Builds on the already-covered Phi-1 textbook-data approach rather than inventing synthetic-data training. Generalization, phone latency and benchmark parity are configuration-specific. Later Phi3.5/MoE additions are excluded from the original v1 record.

Evidence

The linked original sources describe the stated contribution and its evidence limits. WRS has not independently rerun the experiments or certified a proof. Builds on the already-covered Phi-1 textbook-data approach rather than inventing synthetic-data training. Generalization, phone latency and benchmark parity are configuration-specific. Later Phi3.5/MoE additions are excluded from the original v1 record.

Contributors

Provisional WRS assessment, edition 2026-10-16.1. Independent expert calibration is pending. This grade does not certify correctness or assign ownership.

Full scientific record · Browse contribution grades · Request a correction