精读DeepSeek OCR论文，我远远看到了「世界模型」的轮廓

Core Insights - DeepSeek OCR is a notable OCR model but is considered overhyped compared to leading models in the field [1] - The model's performance in specific tasks, such as mathematical formula recognition and table structure identification, is subpar compared to smaller models like PaddleOCR-VL [2][5] - DeepSeek's approach to visual token compression is innovative, aiming to explore the boundaries of visual-text compression [14][15] Model Performance Comparison - DeepSeek OCR has a parameter size of 3 billion and achieves an accuracy of 86.46% with a compression ratio of 10-12 times, maintaining around 90% accuracy [10][14] - In contrast, PaddleOCR-VL, with only 0.9 billion parameters, outperforms DeepSeek in specific tasks [2][5] - Other models like MinerU2.5 and dots.ocr also show higher performance metrics in various tasks [2] Innovation and Research Direction - DeepSeek emphasizes a biological-inspired forgetting mechanism for compression, where recent context is kept high-resolution while older context is progressively blurred [12][11] - The research indicates that optical context compression is not only technically feasible but also biologically reasonable, providing a new perspective for long-context modeling [14][15] - The model's findings suggest a shift in focus from language-based models to visual-based models, potentially leading to breakthroughs in AI research [20][22] Industry Context - DeepSeek represents a unique case in the Chinese tech landscape, where it combines a romantic idealism for technology with practical applications, diverging from typical profit-driven models [6] - The company is seen as a rare entity that prioritizes exploration of advanced technologies over immediate commercial success [6] - The insights from DeepSeek's research could redefine how AI systems process information, moving towards a more visual-centric approach [20][21]