Core Insights - The article discusses the introduction of a new technology called Reality Proxy, which enhances human-computer interaction by allowing users to manipulate real-world objects through a digital interface, effectively bridging the gap between physical and digital realms [5][7][12]. Group 1: Technology Overview - Reality Proxy enables users to select and interact with real-world objects seamlessly by using a digital representation, overcoming limitations related to distance and size [5][7]. - The technology involves three main steps: activating proxies, generating proxies, and interacting with proxies, which allows for a more intuitive user experience [8][9][10]. - The system retains spatial relationships between objects, allowing users to manipulate them without the need for precise physical interaction [10][12]. Group 2: Interaction Features - Users can browse object information quickly, select multiple objects, filter by attributes, and create custom groups, enhancing the flexibility of interactions with real-world items [14][18][25]. - The technology supports intuitive interactions by utilizing physical surfaces as touchpads, allowing users to engage with objects using familiar gestures [20]. - Visual feedback is provided to users during interactions, ensuring they remain focused on the real-world objects while engaging with their digital counterparts [12][14]. Group 3: Practical Applications - Reality Proxy has practical applications in various scenarios, such as quickly locating specific books in an office or interacting with kitchen appliances [28][30]. - The technology also extends to controlling dynamic real-world objects, demonstrated through a mixed-reality drone control application [33]. - User evaluations indicate that Reality Proxy effectively addresses challenges related to interacting with distant or hard-to-reach objects, making it particularly beneficial for users with mobility issues [36].