端侧原生大模型
Search documents
上海交大发布多项AI重大科研成果 启动AI未来发展计划
Zhong Guo Xin Wen Wang· 2025-07-26 22:50
Core Insights - Shanghai Jiao Tong University (SJTU) and Xuhui District Government hosted the "AI Future Development Forum: Super Intelligence, Boundless Co-creation" as part of the 2025 World Artificial Intelligence Conference, showcasing significant AI research achievements and the potential for large-scale applications in various industries [1][3] Group 1: AI Research Achievements - SJTU introduced the Innovator scientific base model and the SciMaster research intelligence system, which demonstrate global leadership in scientific multimodal understanding and reasoning capabilities, serving millions of users through an open-source research platform [2] - The first-ever end-side native sparse large model was presented, designed to match heterogeneous computing power and memory constraints of end devices, enabling efficient deployment of a 10 billion parameter model without the need for internet connectivity [2] Group 2: AI Future Development Initiatives - The forum launched the AI Future Fund, initiated by SJTU's AI Institute and supported by outstanding alumni, focusing on connecting global young AI talents through seed research and innovation programs [3] - A collaborative research initiative with Nature was announced to address ten future AI questions, aiming to identify forward-looking and interdisciplinary topics in the AI field, with results to be published during SJTU's 130th anniversary in 2026 [5]
本智激活完成数千万元种子轮融资,加速端侧 AI 全面落地
Tai Mei Ti A P P· 2025-07-24 02:31
Core Insights - "BenZhi Activation" is a startup incubated from Shanghai Jiao Tong University's Institute of Parallel and Distributed Systems (IPADS), which is renowned for its expertise in operating systems and distributed systems, ranking first globally in the CSRankings for the past decade [2] - The team, led by CEO Mi Zeyu, focuses on edge-native AI solutions, aiming to transform personal AI paradigms by addressing privacy concerns, high costs, and lack of personalization in cloud-based AI models [2][3] Group 1: Technological Innovations - "BenZhi Activation" proposes a disruptive "edge-native" full-stack design that reconstructs the software and hardware technology system from the ground up, achieving true edge intelligence without sacrificing model intelligence [3] - The team has achieved significant breakthroughs in edge model algorithms and infrastructure, including the release of the PowerInfer edge model infrastructure system, which operates a trillion-parameter model efficiently on consumer-grade NVIDIA GTX 4090 GPUs, achieving 90% of the performance of data center-level A100 GPUs [4] - The upcoming PowerInfer-2, set to launch in June 2024, will enable the smooth operation of a 47 billion-parameter model on smartphones, surpassing the performance of international benchmarks by 29 times [4][5] Group 2: Market Impact and Future Prospects - The first batch of edge-native models will be released and open-sourced on July 26, 2025, featuring original algorithm architectures designed specifically for edge devices, allowing for smooth operation on budget hardware [5] - Industry experts highlight the growing demand for privacy protection and low latency, positioning edge intelligence as a key entry point connecting the virtual and physical worlds, with "BenZhi Activation" leading the way in low-cost, efficient deployment of large models on mainstream devices [6] - The company is recognized as one of the few globally with top-tier R&D capabilities and mass production experience in edge AI, indicating a strong potential for future growth and innovation in the sector [6]