SenseFlow: Scaling Distribution Matching for Flow-based Text-to-Image Distillation
Hong Kong University of Science and Technology · Beijing University of Posts and Telecommunications · Tsinghua University, Zhipu AI · SenseTime · Tsinghua University, Tsinghua University · The Hong Kong University of Science and Technology
PDF 由论文原始站点提供，PaperCompass 不保存论文文件。
摘要
The Distribution Matching Distillation (DMD) has been successfully applied to text-to-image diffusion models such as Stable Diffusion (SD) 1.5. However, vanilla DMD suffers from convergence difficulties on large-scale flow-based text-to-image models, such as SD 3.5 and FLUX. In this paper, we first analyze the issues when applying vanilla DMD on large-scale models. Then, to overcome the scalability challenge, we propose implicit distribution alignment (IDA) to constrain the divergence between the generator and the fake distribution. Furthermore, we propose intra-segment guidance (ISG) to relocate the timestep denoising importance from the teacher model. With IDA alone, DMD converges for SD 3.5; employing both IDA and ISG, DMD converges for SD 3.5 and FLUX.1 dev. Together with a scaled VFM-based discriminator, our final model, dubbed **SenseFlow**, achieves superior performance in distillation for both diffusion based text-to-image models such as SDXL, and flow-matching models such as SD 3.5 Large and FLUX.1 dev. The source code is available at https://github.com/XingtongGe/SenseFlow.