Core Insights - Qifu Technology, in collaboration with Fudan University and South China University of Technology, has launched the first multimodal evaluation benchmark for credit scenarios, named FCMBench-V1.0, aimed at enhancing AI applications in credit assessment [1][2] - The benchmark is designed to address real credit business scenarios, focusing on multi-modal evaluation tasks that reflect practical business needs, thereby promoting academic research and application in credit AI [1] - Unlike traditional evaluations that focus on single recognition or understanding capabilities, this benchmark assesses model capabilities relevant to key processes in micro-enterprise credit granting, such as multi-document recognition and risk clue discovery [1] Summary by Sections - Benchmark Development: The FCMBench-V1.0 provides a standardized evaluation platform to foster collaboration between academia and industry, enabling fair comparisons of AI model capabilities in the credit field [1] - Data and Framework: The benchmark includes a highly consistent evaluation framework with 18 core credit document types, comprising 4,043 compliant images and 8,446 test samples, covering the entire credit review process [2] - Industry Impact: This initiative aims to break down data and knowledge barriers within the industry, facilitating a shift from "single-point optimization" to "collaborative innovation" between academia and financial technology companies [1]
奇富科技发布首个信贷多模态评测基准