Workflow
GeoFlow V2
icon
Search documents
入选ICML 2025,Meta/剑桥/MIT提出全原子扩散Transformer框架,首次实现周期性与非周期性原子系统统一生成
3 6 Ke· 2025-07-14 09:52
Core Insights - Meta FAIR, Cambridge University, and MIT have introduced the All-atom Diffusion Transformer (ADiT), which breaks the modeling barrier between periodic and non-periodic systems, enabling the generation of molecules and crystals using a single model [1][3][5] - The ADiT framework shows significant potential in the field of atomic system 3D structure generation, which could revolutionize the reverse design of new molecules and materials [1][18] - Current diffusion models face challenges in cross-system generalization, as they often rely on specific system characteristics, leading to compatibility issues [1][2] Research Highlights - ADiT achieves a unified generative model for both periodic materials and non-periodic molecular systems [5] - The model simplifies the generation process with minimal inductive bias, enhancing training and inference efficiency compared to traditional models [3][5] - ADiT demonstrates remarkable scalability and efficiency, reducing the time to generate 10,000 samples from 2.5 hours to under 20 minutes on the same hardware [3][14] Experimental Data - The research utilized multiple representative datasets, including MP20 (45,231 metastable crystal structures), QM9 (130,000 stable organic molecules), GEOM-DRUGS (430,000 large organic molecules), and QMOF (14,000 metal-organic frameworks) [7][8] - ADiT's performance was evaluated against various baseline models, achieving state-of-the-art results in both crystal and molecular generation tasks [12][14] Model Architecture - ADiT is built on two core ideas: a unified potential representation for all-atom systems and the use of a Transformer for latent diffusion [9][10] - The first phase involves constructing an autoencoder for reconstruction, while the second phase utilizes a latent diffusion generative model to generate new samples [10][12] Performance Metrics - ADiT shows a predictable linear improvement in performance as model parameters scale up to 500 million, indicating a strong correlation between model size and performance [13] - In terms of efficiency, ADiT outperforms traditional models, achieving comparable results with significantly faster inference times [14][16] Industry Implications - The advancements in atomic system 3D structure generation modeling are being driven by both academic and corporate research, with notable contributions from institutions like UC Berkeley and companies like ByteDance [17][18] - The ongoing technological progress in this field is expected to play a crucial role in new material development and drug design, addressing global scientific challenges [18]