Nvidia(US:NVDA)2026-02-03 07:02Summary of NVIDIA Conference Call on Co-package Silicon Photonic Switch for Gigawatt AI Factories Company and Industry - Company: NVIDIA (NasdaqGS: NVDA) - Industry: AI Supercomputing and Data Center Infrastructure Core Points and Arguments 1. AI Supercomputer Infrastructure: The presentation emphasized the evolution of data centers into AI supercomputers, where multiple computing elements are interconnected to handle AI workloads effectively [3][4] 2. Scale-Up and Scale-Out Networks: NVIDIA's infrastructure includes NVLink for scale-up (connecting H100 GPUs) and Spectrum-X Ethernet for scale-out (connecting multiple racks) to form a large data center capable of running distributed AI workloads [4][5] 3. Context Memory Storage: The integration of BlueField DPUs for context memory storage is crucial for meeting the storage requirements of inferencing workloads [6] 4. Scale Across Infrastructure: The need to connect multiple data centers is addressed through Spectrum-X Ethernet, enabling a single computing engine to support large-scale AI factories [7] 5. Spectrum-X Ethernet Design: This Ethernet technology is specifically designed for AI workloads, focusing on high performance and low jitter, which is essential for distributed computing [9][10] 6. Performance Improvements: Spectrum-X Ethernet has shown a 3x improvement in expert dispatch performance and a 1.4x increase in training performance, ensuring all GPUs work synchronously [12][13] 7. Power Consumption and Efficiency: The optical connectivity in data centers can consume up to 10% of computing resources, and reducing this power consumption is vital for enhancing compute capability [14] 8. Co-package Optics Introduction: Co-package optics integrates the optical engine within the switch, significantly reducing power consumption by up to 5x and increasing the resiliency of the data center [15][18] 9. Optical Engine Design: The optical engine consists of a photonic IC and electronic IC, designed to improve signal integrity and reliability [20][21] 10. Deployment Timeline: Co-package optics deployments are expected to begin in 2026, with initial partners including CoreWeave, Lambda, and Texas Advanced Computing Center [26] Additional Important Content 1. Reliability Issues: Previous optical networks faced reliability issues due to human handling of external transceivers. Co-package optics mitigates this by integrating the optical engine within the switch, reducing human touch and increasing reliability [27][29] 2. Collaboration with TSMC: The partnership with TSMC focuses on creating a reliable packaging process for co-package optics, which is crucial for mass production [30][31] 3. Flexibility of Co-package Optics: Unlike traditional pluggable optics, co-package optics offers a unified technology that can cover various distances within and between data centers, reducing the need for multiple transceivers [37][38] 4. Adoption Challenges: Hyperscalers may be cautious about adopting co-package optics due to concerns over the initial investment and the transition from pluggable optics, but the benefits in power efficiency and resiliency are expected to drive adoption [39][40] 5. Future Innovations: Continuous innovation is anticipated in switch design, optical network density, and overall data center efficiency, with a focus on larger radix switches and improved cooling solutions [54][55] This summary encapsulates the key points discussed during the NVIDIA conference call, highlighting the advancements in AI supercomputing infrastructure and the introduction of co-package optics technology.