模型「漂移」新范式，何恺明新作让生成模型无须迭代推理

Core Viewpoint - The article introduces the "Drifting Model," a novel generative modeling paradigm that eliminates the need for iterative inference processes, thereby enhancing efficiency in generating high-quality outputs [3][7][26]. Group 1: Generative Modeling Techniques - Traditional generative models, such as diffusion models, rely on iterative processes and differential equations to map distributions, making them time-consuming and resource-intensive [1][2]. - Variational Autoencoders (VAEs) and Normalizing Flows (NFs) are also discussed as methods that attempt to streamline the generation process, but they still face challenges related to iterative training [2][3]. Group 2: Drifting Model Characteristics - The Drifting Model utilizes a pushforward mapping that evolves during training, allowing for single-step inference without the iterative nature of previous models [7][8]. - A drifting field is introduced to control the movement of samples, ensuring that the generated distribution aligns with the target data distribution [8][10]. Group 3: Experimental Results - The Drifting Model achieved a state-of-the-art (SOTA) FID score of 1.54 on ImageNet 256×256 under standard latent space generation protocols, demonstrating competitive performance even against multi-step diffusion models [14][24]. - In challenging pixel space generation protocols, the model reached an FID of 1.61, significantly outperforming previous pixel space methods [14][26]. Group 4: Robustness and Efficiency - The model exhibits robustness against mode collapse, maintaining the ability to approximate multi-modal target distributions effectively [16][17]. - The research highlights the importance of robust feature representations in generative modeling, indicating that advancements in self-supervised learning can directly benefit this paradigm [26]. Group 5: Implications for Future Research - The findings suggest that the principles of distribution evolution through drifting fields could be broadly applicable across various generative tasks, opening new avenues for efficient generative modeling research [26].