MarsEngine

Search documents
从60场景到10亿调用量:阿里国际AI商业化的技术破局之路
Sou Hu Cai Jing· 2025-07-28 02:39
Core Insights - Alibaba International's AI solution Marco has achieved an impressive daily usage of 1 billion calls, marking a significant milestone in the cross-border e-commerce sector and representing a 1000-fold increase compared to 2023 [1] - The SAIL Star Award was granted to Marco at the World Artificial Intelligence Conference, highlighting its status as a groundbreaking AI application [1] Technical Milestones Behind SAIL Star - The AIBusiness team, established in April 2023, has developed Marco over two years, transitioning from a single-function model to a comprehensive solution covering over 60 scenarios in e-commerce, with support for more than 30 languages [3] - Marco's core innovation lies in deeply integrating large model technology into specific business applications, creating a complete loop from technology development to commercial monetization [3] Evolution of Five-Layer Technical Architecture - Marco's success is attributed to its unique five-layer technical architecture, featuring a self-developed inference engine, MarsEngine, which has achieved a 116% throughput improvement in translation scenarios compared to industry-standard engines [4] - This foundational performance breakthrough ensures high-frequency calls are technically supported, with real-time latency reduced to one-eighth of competitors [4] AI Technology Industrialization - The daily 1 billion call volume exemplifies AI technology's transition from laboratory settings to industrial applications, contrasting with the common industry challenge of "impressive demonstrations but difficult implementations" [5] - Marco's standardized capability output and scenario-based solutions demonstrate sustainable operational capacity for AI in complex business environments [5] Aidge Open Platform and Ecological Revolution - Alibaba International's broader strategy includes the Aidge open platform, which has seen a 23-fold increase in external partner call volumes by open-sourcing core models like Marco and collaborating with leading service providers [7] - This "technology sharing-ecosystem co-construction-business win-win" model enables exponential growth in call volumes every two months [7] Significance of Cross-Border E-commerce in AI Application - Cross-border e-commerce is emerging as a leading field for large-scale AI applications, with implications that extend beyond the success of a single company [9] - The open development of tools like the AgenticADK framework is shifting the power of industry standard-setting, emphasizing the broader industrial value recognized by the SAIL Star judging panel [9] Insights on Large-Scale AI Application Era - Marco's implementation illustrates that the breakthrough in AI commercialization lies in the integration of deep technology, broad scenarios, and robust ecosystems [10] - This methodology is redefining the relationship between AI and industry, moving from isolated intelligence to comprehensive, end-to-end solutions [10]
阿里国际AI解决方案Marco获世界人工智能大会SAIL之星
Guan Cha Zhe Wang· 2025-07-27 03:58
Core Insights - Alibaba's international cross-border e-commerce AI solution, Marco, won the SAIL Star Award at the 2025 World Artificial Intelligence Conference, marking it as the first recipient in this field [1] - Marco, developed by Alibaba's AI Business team, supports over 30 languages and covers more than 60 scenarios across the e-commerce value chain, providing solutions for marketing, compliance, and after-sales at a lower cost than mainstream large models [1] - The daily usage of Marco has reached 1 billion calls, a 1000-fold increase compared to 2023, and all capabilities are available for trial on Alibaba's AI open platform, Aidge [1] Technology and Application - In April 2023, Alibaba International Digital Commerce Group established a dedicated AI large model department, AI Business, to explore AI technology in global e-commerce scenarios [3] - All e-commerce platforms under Alibaba International have integrated AI solutions, with the most frequently used AI features being image translation, image recognition for product information enhancement, and marketing copy generation [3] - The translation feature transitioned from small models to large models by the end of last year, resulting in a 30% increase in consumer satisfaction in top European languages due to improved translation quality [3] - AI-driven SEO now accounts for nearly 40% of overall SEO efforts, with potential to reach 50% or more in the future [3] - External partners have seen a 23-fold increase in AI usage, with major cross-border e-commerce service providers integrating Alibaba's AI services [3] - The call volume for Alibaba's AI services doubles every two months, with an average daily call volume exceeding 1 billion as of July 2025, making cross-border e-commerce the first industry to achieve large-scale AI application [3] Technical Architecture - Alibaba International AI Business has developed a comprehensive AI solution for cross-border e-commerce, consisting of a five-layer technical architecture [4] - The infrastructure layer includes the MarsEngine inference engine, which optimizes token generation scheduling, KV cache, operator fusion, and computation, achieving a 116% improvement in extreme throughput compared to industry-leading engines [5] - The data layer has established a large-scale data collection, processing, and screening platform for model training, along with an evaluation framework for industrial applications [5] - The model layer offers multi-language enhanced Marco-LLM, e-commerce optimized translation model Marco-MT, self-developed multi-modal understanding model Ovis, and image generation model [5] - The product layer provides standardized capabilities for various business scenarios [5] - The AI solution layer delivers end-to-end AI capabilities or product collections for high-value scenarios [5]