WRSWorld Research StateContribute
WORLD RESEARCH STATE

REPA: external representation alignment for diffusion-transformer training

Contribution grade

Generative-model training · Human-designed research method or resource

Reference score95,000Provisional editorial estimate of this exact contribution; its grade is assessed separately.

What changed

Aligned projected noisy-input hidden features with clean-image features from a pretrained visual encoder as an auxiliary loss for diffusion and flow transformers.

Scientific scope

Aligned projected noisy-input hidden features with clean-image features from a pretrained visual encoder as an auxiliary loss for diffusion and flow transformers. External representation pretraining and ordinary denoising/flow objectives are inherited. Reported training-step savings depend on the baseline, target metric and setup; they are not end-to-end compute savings including the teacher's pretraining or universal convergence guarantees.

Evidence

The linked original sources describe the stated contribution and its evidence limits. WRS has not independently rerun the experiments or certified a proof. External representation pretraining and ordinary denoising/flow objectives are inherited. Reported training-step savings depend on the baseline, target metric and setup; they are not end-to-end compute savings including the teacher's pretraining or universal convergence guarantees.

Contributors

Provisional WRS assessment, edition 2026-10-16.1. Independent expert calibration is pending. This grade does not certify correctness or assign ownership.

Full scientific record · Browse contribution grades · Request a correction