Revolutionary Fusion: Event Sensors and Hand-Tracking Unite for Next-Gen AR Devices

Ultraleap and Prophesee have partnered to develop an innovative system that combines event sensors and hand tracking in augmented reality (AR) devices.

This collaboration leverages Ultraleap's computer vision and machine learning (ML) models along with Prophesee's GenX320 event-based Metavision sensors. By reducing power consumption, this system enables an always-on AR device that can track user's hand interactions for longer periods of time.

Moreover, the new Ultraleap models for event sensors offer improved performance in adverse light conditions and lower latency, paving the way for a new era of outdoor interaction capabilities.

One of the key advantages of this system is enhanced privacy. Since event sensors are not frame-based and only capture pixel movement information, users can enjoy all these features while maintaining their privacy.

The GenX320 sensors from Prophesee provide "always on" capabilities, making them ideal for use in an event-based ML vision system for hand tracking in AR. When combined with Ultraleap's technology, these sensors enable robust and immersive interaction methods in a convenient glasses form factor, which is crucial for widespread adoption of augmented reality.