Workflow
大模型智能体开发平台
icon
Search documents
大模型专题:2025年大模型智能体开发平台技术能力测试研究报告
Sou Hu Cai Jing· 2025-08-14 15:48
Core Insights - The report evaluates the technical capabilities of four major AI model development platforms: Alibaba Cloud's Bailian, Tencent Cloud's Intelligent Agent Development Platform, Kouzi, and Baidu Intelligent Cloud Qianfan, focusing on RAG capabilities, workflow capabilities, and agent capabilities [1][7][8]. RAG Capability Testing - RAG capability testing assesses knowledge enhancement mechanisms, including multi-modal knowledge processing, task complexity adaptation, and interaction mechanism completeness [7][8]. - In text question answering, all platforms demonstrated high accuracy, with over 80% accuracy in multi-document responses, although some platforms showed stability issues during API calls [20][21]. - Baidu Intelligent Cloud Qianfan exhibited stable performance in complex query scenarios for structured data, while Tencent Cloud achieved 100% refusal for out-of-knowledge-base questions [21][23]. - The platforms showed differences in handling refusal and clarification, with Tencent Cloud providing 100% refusals for non-knowledge-base questions [21][22]. Workflow Capability Testing - Workflow capability testing focuses on dynamic parameter extraction, exception rollback, intent recognition, and fault tolerance [35][36]. - The end-to-end accuracy for workflow processes ranged from 61.5% to 93.3%, with Tencent Cloud leading in intent recognition accuracy at 100% [36][37]. - The platforms demonstrated basic usability in workflow systems, but there is room for improvement in complex information processing [38][39]. Agent Capability Testing - Agent capability testing evaluates the ability to call tools, focusing on intent understanding, operational coordination, feedback effectiveness, and mechanism completeness [44][45]. - All platforms achieved high single-tool call completion rates (83%-92%), but multi-tool collaboration and prompt calling showed potential for improvement [48][50]. - Tencent Cloud's Intelligent Agent Development Platform excelled in tool call success rates due to its robust ecosystem and process optimization [49][50].