医疗AI有了“评审员”！北京启动医疗人工智能应用评测服务

Core Viewpoint - The rapid advancement of artificial intelligence (AI) technology is driving the development of medical AI to assist doctors and take on some of their technical tasks, raising concerns about the safe and effective application of medical AI [1][3] Group 1: Establishment of Evaluation Center - The Beijing Municipal Health Commission has established a Medical AI Application Evaluation Center to create a regulatory framework and standards for medical AI evaluation [1][3] - The center aims to validate the clinical decision-making capabilities and effectiveness of medical AI, ensuring safety in its application [1][3] Group 2: Evaluation Criteria - Medical AI applications will be evaluated similarly to doctors, focusing on multiple dimensions such as safety, professionalism, and practicality [3] - A multi-dimensional assessment standard has been developed, consisting of six core evaluation dimensions: medical compliance and ethics, evidence-based medicine and knowledge, general auxiliary capabilities, specialty diagnosis and treatment quality control, adaptability of diagnosis and treatment processes, and accuracy of diagnostic decisions, encompassing over 70 specific evaluation tasks [3][4] Group 3: Data and Methodology - The evaluation center collaborates with key hospitals, research institutions, and authoritative expert teams to construct a high-quality evaluation dataset using clinical cases and authoritative medical guidelines [3][4] - An innovative AI-based scoring mechanism has been introduced to ensure objective and scientific evaluation results, focusing on reasoning logic and diagnostic thought processes rather than just final outcomes [4] Group 4: Future Plans - The evaluation center plans to expand its evaluation services to cover various medical fields, including internal medicine, surgery, and pediatrics, to support the healthy development of the medical AI industry and better meet public health needs [5]