Apple Vision Pro is a lot of things, but most importantly, it's amazing technology. Whether people like it, hate it, or just generally don't want to spend $3,500 on it, almost everyone agrees that Apple has achieved some amazing technical achievements with the headset. Agree.
One of the most impressive parts of the Vision Pro is its eye tracking system. High-performance eye-tracking systems rely on sophisticated, miniature infrared cameras in the eyepieces that project invisible patterns of light into each eye of the wearer. These infrared cameras quickly and accurately track where you are looking, allowing you to control the entire operating system and user interface through gaze and hand gestures. These gestures are tracked and analyzed using an external camera on the bottom of the Vision Pro headset.
The fine folks at The Slow Mo Guys took a peek at the Vision Pro's infrared camera and light using a high-speed camera without the typical infrared-blocking filters that most cameras (and the human eye) have. Ta. Of course, not all interchangeable lens digital cameras block infrared rays.
Apple Vision Pro has an infrared illuminator on the front of the headset that provides important data about your surroundings. Inside, there appear to be at least 8 infrared emitters in each eye, for a total of at least 16 infrared emitters. Together with the three on the front, the total number of infrared lights on the Vision Pro is just under 20.
Apple is famously in a very precarious situation. However, the Vision Pro has 2 high-resolution main cameras, 6 world-facing tracking cameras (on the outside of the Vision Pro when worn), and his 4 eye-tracking cameras inside the headset. explained. These four internal cameras capture and track infrared light projected by 16 IR illuminators.
Apple is no stranger to infrared and sensors. The company uses infrared sensors with its FaceID technology to unlock many iPhone and iPad devices. Apple devices also use infrared sensors to measure ambient light and adjust screen brightness. Additionally, LiDAR technology relies on infrared wavelengths, similar to those used for low-light autofocus and depth measurement.
Image credits: apple