Core Insights - The article discusses the introduction of a new technology called Reality Proxy, which enhances human-computer interaction by allowing users to manipulate real-world objects through a digital interface, effectively bridging the gap between physical and digital realms [5][7][12]. Group 1: Technology Overview - Reality Proxy enables users to select and interact with real-world objects seamlessly by using a digital representation, overcoming limitations related to distance and size [5][7]. - The technology involves three main steps: activating proxies, generating proxies, and interacting with proxies, which allows for a more intuitive user experience [8][9][10]. - The system retains spatial relationships between objects, allowing users to manipulate them without the need for precise physical interaction [10][12]. Group 2: Interaction Features - Users can browse object information quickly, select multiple objects, filter by attributes, and create custom groups, enhancing the flexibility of interactions with real-world items [14][18][25]. - The technology supports intuitive interactions by utilizing physical surfaces as touchpads, allowing users to engage with objects using familiar gestures [20]. - Visual feedback is provided to users during interactions, ensuring they remain focused on the real-world objects while engaging with their digital counterparts [12][14]. Group 3: Practical Applications - Reality Proxy has practical applications in various scenarios, such as quickly locating specific books in an office or interacting with kitchen appliances [28][30]. - The technology also extends to controlling dynamic real-world objects, demonstrated through a mixed-reality drone control application [33]. - User evaluations indicate that Reality Proxy effectively addresses challenges related to interacting with distant or hard-to-reach objects, making it particularly beneficial for users with mobility issues [36].

Core Viewpoint - The article discusses the introduction of Reality Proxy, a technology that enhances mixed reality (XR) interactions by allowing users to manipulate real-world objects through digital proxies, thereby overcoming limitations of traditional XR devices [11][12][14]. Group 1: Technology Overview - Reality Proxy enables seamless interaction with real-world objects by creating abstract digital representations of them, allowing users to select and manipulate these proxies instead of the physical objects directly [9][12]. - The technology aims to improve user experience by addressing challenges such as small object sizes, unstable line of sight, and hand tremors that often hinder traditional XR interactions [11][14]. - The process involves three main steps: activating the proxy, generating the proxy while retaining spatial relationships, and interacting with the proxy while maintaining focus on the real-world object [15][16][21]. Group 2: Interaction Features - Users can browse object previews by sliding their fingers over multiple proxies, select multiple objects by defining an area with hand gestures, and filter objects by attributes [27][28][29]. - The system supports intuitive interactions by utilizing physical surfaces as touchpads, allowing users to perform familiar gestures to select and manipulate objects [30]. - Additional features include semantic grouping, spatial scaling, and custom grouping, enhancing the flexibility of user interactions with real-world objects [32][35][37]. Group 3: Practical Applications - Reality Proxy can be applied in various scenarios, such as quickly locating specific books in an office, interacting with kitchen appliances, and navigating large buildings efficiently [38][40][42]. - The technology also facilitates the control of dynamic real-world objects, exemplified by a mixed reality application for drone control [44][45]. Group 4: User Feedback and Evaluation - The evaluation of Reality Proxy indicated positive feedback regarding its practicality, ease of learning, and usability, particularly in addressing interaction challenges with distant or hard-to-reach objects [48][50]. - Participants noted that the system is faster than traditional methods, reduces physical fatigue, and is more accommodating for users with mobility or visual stability issues [51]. - Some concerns were raised about the learning curve for new users and the need for improved accuracy in proxy positioning [52].