Workflow
AI眼镜“隔空取物”,戴上即可随心选中现实世界任意物体
具身智能之心·2025-08-09 00:48

Core Viewpoint - The article discusses the introduction of a new technology called Reality Proxy, which enhances human-computer interaction by allowing users to seamlessly select and manipulate real-world objects through a mixed reality interface, overcoming limitations of traditional XR devices [10][13][14]. Group 1: Technology Overview - Reality Proxy is a digital representation of real-world objects that allows users to interact with them without being hindered by physical constraints such as distance or size [14][16]. - The interaction process involves three main steps: activating the proxy, generating the proxy, and interacting with the proxy [17][19][24]. - The system captures the semantic structure of the environment and creates proxies that maintain spatial relationships, allowing for intuitive manipulation [20][22]. Group 2: Interaction Features - Users can browse object previews, select multiple objects, filter objects by attributes, and utilize physical features for interaction [30][31][32][34]. - The technology supports semantic grouping and custom grouping, enabling users to organize and manipulate objects efficiently [36][40]. Group 3: Practical Applications - Reality Proxy can be applied in various scenarios, such as quickly locating specific books in an office or interacting with kitchen appliances [41][43]. - It facilitates efficient navigation and interaction in large buildings and allows for dynamic control of real-world objects like drones [45][47]. Group 4: User Feedback and Evaluation - Participants in the study found Reality Proxy to be practical and effective in addressing interaction challenges with distant or hard-to-reach objects [53]. - The system was praised for its speed and reduced physical fatigue, although some users noted a learning curve and the need for improved accuracy in proxy positioning [54][55].