Core Viewpoint - The article discusses the limitations of AI models in accurately interpreting images, highlighting that these models rely on memory and biases rather than true visual observation [19][20][48]. Group 1: AI Model Limitations - All tested AI models, including Grok4, OpenAI o3, and Gemini, consistently miscounted the number of fingers in an image, indicating a systemic issue in their underlying mechanisms [11][40]. - A recent paper titled "Vision Language Models are Biased" explains that large models do not genuinely "see" images but instead rely on prior knowledge and memory [14][19]. - The AI models demonstrated a strong tendency to adhere to preconceived notions, such as the belief that humans have five fingers, leading to incorrect outputs when faced with contradictory evidence [61][64]. Group 2: Experiment Findings - Researchers conducted experiments where AI models were shown altered images, such as an Adidas shoe with an extra stripe, yet all models incorrectly identified the number of stripes [39][40]. - In another experiment, AI models struggled to accurately count legs on animals, achieving correct answers only 2 out of 100 times [45]. - The models' reliance on past experiences and biases resulted in significant inaccuracies, even when prompted to focus solely on the images [67]. Group 3: Implications for Real-World Applications - The article raises concerns about the potential consequences of AI misjudgments in critical applications, such as quality control in manufacturing, where an AI might overlook defects due to its biases [72][76]. - The reliance on AI for visual assessments in safety-critical scenarios, like identifying tumors in medical imaging or assessing traffic situations, poses significant risks if the AI's biases lead to incorrect conclusions [77][78]. - The article emphasizes the need for human oversight in AI decision-making processes to mitigate the risks associated with AI's inherent biases and limitations [80][82].

Core Viewpoint - The article discusses the inherent biases in AI visual models, emphasizing that these models do not truly "see" images but rely on memory and preconceived notions, leading to significant errors in judgment [8][24][38]. Group 1: AI Model Limitations - All tested AI models consistently miscounted the number of fingers in an image, with the majority asserting there were five fingers, despite the image showing six [5][12][17]. - A study titled "Vision Language Models are Biased" reveals that AI models often rely on past experiences and associations rather than actual visual analysis [6][8][18]. - The models' reliance on prior knowledge leads to a failure to recognize discrepancies in images, as they prioritize established beliefs over new visual information [24][28][36]. Group 2: Implications of AI Bias - The article highlights the potential dangers of AI biases in critical applications, such as quality control in manufacturing, where AI might overlook defects due to their rarity in the training data [30][34]. - The consequences of these biases can be severe, potentially leading to catastrophic failures in real-world scenarios, such as automotive safety [33][35]. - The article calls for a cautious approach to relying on AI for visual judgments, stressing the importance of human oversight and verification [34][39].