Core Insights - Beijing has launched an evaluation service for artificial intelligence applications in the medical field, aimed at ensuring safety, professionalism, applicability, and accuracy of AI diagnostics [1][2] Evaluation Framework - The evaluation center has developed a comprehensive assessment index system consisting of over 70 specific evaluation tasks, covering six core dimensions [1] - The evaluation focuses on safety, professionalism, applicability, and accuracy, including checks for privacy breaches, adherence to medical ethics, use of the latest medical textbooks and guidelines, and the rationality of AI-generated treatment suggestions [1] Data and Methodology - The evaluation center collaborates with key hospitals, research institutions, and expert teams to construct a high-quality evaluation dataset using clinical cases and authoritative medical resources [1] - The evaluation process includes three stages: user application, system evaluation, and expert review, with an innovative AI-based scoring mechanism to quantify the diagnostic reasoning and logic of AI applications [2] Focus Areas - The initial evaluation service will concentrate on the field of thoracic surgery, with plans to expand to other medical specialties such as internal medicine, surgery, and pediatrics in the future [2]