Stonehill Technology(SZ:002195)2024-03-15 09:43Group 1: Company Overview - Shanghai Yanshan Technology Co., Ltd. established the Yanshan Brain-like Artificial Intelligence Research Institute in August 2023, focusing on brain signal decoding and intervention for non-organic brain diseases [2][4]. - The research institute is led by Dr. Li Meng, a postdoctoral researcher from Harvard University, and aims to commercialize research outcomes in brain science and artificial intelligence [2][3]. Group 2: RockAI Business Introduction - RockAI, established in June 2023, has developed the Yan 1.0 model, the first general model in China without an Attention mechanism, launched in January 2024 [3][4]. - The Yan 1.0 model demonstrates higher training efficiency, requiring only 1.5 hours to reach a loss of 3.0, compared to 10.5 hours for the LLaMA 2 model [7]. Group 3: Technical Innovations - The Yan architecture reduces computational complexity from O(n^2d) to O(nd), enhancing training speed and efficiency [5][6]. - The Yan model maintains stable memory usage around 14G, while LLaMA 2 experiences memory shortages when output token lengths exceed 2,600 [7]. Group 4: Future Developments - RockAI plans to release the Yan 2.0 model in the second half of 2024, integrating multimodal capabilities including text, audio, and video [8]. - The company is also pursuing the acquisition of Nullmax Technology, with ongoing regulatory approvals for overseas investment [8].