| 机器之心报道 | | --- | | 编辑：杜伟、+0 | 这几天，一篇关于向量嵌入（Vector Embeddings）局限性的论文在 AlphaXiv 上爆火，热度飙升到了近 9000。 要理解这篇论文的重要性，我们先简单回顾一下什么是向量嵌入。 图源： veaviate 多年以来，嵌入主要用于「检索」任务，例如搜索引擎中的相似文档查找，或推荐系统中的个性化推荐。随着大模型技术的发展，嵌入的应用开始拓展到推理、 指令遵循、编程等更复杂的任务。这些新兴需求，推动着嵌入技术朝着能处理任何查询、任何相关性定义的方向演进。 然而，先前的研究已经指出了向量嵌入的理论局限性。它的本质，是把一个高维度、复杂的概念（比如「爱」，可能包含亲情、爱情、友情、奉献、占有等无数 面向）强行压缩成一串固定长度的向量。这个过程不可避免地丢失信息，就像三维苹果被拍成二维照片 —— 无论照片多清晰，你都无法从中还原出它的重量、气 味等属性。 过去几年，业界普遍认为这种理论困难可以通过更好的训练数据和更大的模型来克服。这就是过去几年以 OpenAI 为代表的公司所遵循的「大力出奇迹」（Scaling Laws）的哲学。 从 GPT-2 ...

Core Viewpoint - The accuracy of data is crucial for financial services companies utilizing Generative AI (GenAI) and Large Language Models (LLM), as inaccurate or low-quality data can adversely affect company strategy, operations, risk management, and compliance [1][3]. Group 1: Causes of Data Inaccuracy - Data inaccuracy in the financial services sector often arises from multiple factors, including the increasing volume and variety of data sourced from multiple vendors, patents, and third-party sources [4]. - "Hallucination" is a significant challenge in the financial sector regarding Generative AI, where models generate coherent but factually incorrect or misleading information due to their reliance on learned patterns from training data without factual verification [4]. Group 2: Importance of Retrieval-Augmented Generation (RAG) - RAG is a critical technology for improving the accuracy of Generative AI and significantly reducing hallucinations by integrating real data with generated responses [6]. - RAG combines the generative capabilities of LLMs with effective data retrieval systems, allowing for more accurate and contextually relevant answers, especially in financial risk assessments [6]. - RAG enhances the utilization of various data formats, enabling the processing of both structured and unstructured data efficiently, and connects existing legacy systems without the need for costly migrations or retraining of LLMs [7]. Group 3: Benefits of RAG - RAG helps address the main causes of data inaccuracy discussed earlier, providing more accurate answers based on proprietary data and reducing hallucinations [8]. - It allows for the integration of the latest knowledge and user permission management, ensuring that responses are based on up-to-date information [8].