小哥硬核手搓AI桌宠！接入GPT-4o，听得懂人话还能互动，方案可复现

Core Viewpoint - The article discusses the creation of an AI pet named Shoggoth, inspired by the Pixar lamp robot, which utilizes GPT-4o and 3D printing technology to interact with humans in a pet-like manner [1][48]. Group 1: AI Pet Development - Shoggoth is designed to communicate and interact with users, potentially replacing traditional stuffed toys as childhood companions [5][52]. - The robot's structure is simple, featuring a base with three motors and a 3D-printed conical head, along with a flexible tentacle system inspired by octopus grabbing strategies [8][10]. - The robot can adapt to various object sizes and weights, capable of handling items up to 260 times its own weight [8]. Group 2: Control and Interaction Mechanisms - Shoggoth employs a dual-layer control system: low-level control using preset actions and high-level control utilizing GPT-4o for real-time processing of voice and visual events [25][26]. - The robot's perception includes hand tracking and tentacle tip tracking, using advanced models like YOLO for 3D triangulation [30][33]. - A 2D mapping system simplifies the control of tentacle movements, allowing users to manipulate the robot via a computer touchpad [22][24]. Group 3: Technical Challenges and Solutions - Initial designs faced issues with cable entanglement, which were addressed by adding a cable spool cover and calibration scripts to improve tension control [14][16][17]. - The design also required reinforcement of the "spine" structure to prevent sagging under its own weight [18]. - The final model successfully transitioned from simulation to real-world application, validating the effectiveness of the control strategies implemented [38]. Group 4: Creator Background - The creator, Matthieu Le Cauchois, is an ML engineer with a background in reinforcement learning, speech recognition, and NLP, having previously founded an AI company [39][41]. - His work includes various innovative projects, showcasing his expertise in machine learning and robotics [46][48].