Self-transcendence: Is External Feature Guidance Indispensable for Accelerating Diffusion Transformer Training?
arXiv Preprint Archive January 12, 2026 Lingchen Sun, Rongyuan Wu, Zhengqiang Zhang et al.
Recent works such as REPA have shown that guiding diffusion models with external semantic features (e.g., DINO) can significantly accelerate the training of diffusion transformers (DiTs). However, the use of pretrained external features as guidance signals introduces additional dependencies. We argue that DiTs actually have the power to guide the training of themselves, and propose...