Spatial Computing focuses on understanding the 3D space around us and enabling intuitive user interactions with it. It is the underlying technology powering technology trends, such as Augment and Virtual Reality, as well as emerging applications of 3D spatial understanding to areas such as building and construction, logistics and retail.
The Spatial Computing group focuses on using portable and wearable multi-camera based systems for these mapping and tracking tasks, where videos tend to be jerky and less predictable. At present, the goal is to robustly and accurately map the interior of buildings, ranging from large office spaces to narrow corridors, in the time it takes to walk around the spaces to be mapped. Although not as accurate as laser scans, this system is faster, cheaper and can work even with people moving around while the system is mapping.
The second area of focus is towards building a true-3D computational holographic display, which is able to render each pixel at the same depth as the real world 3D space. We also work on acceleration of interactive hologram computation and developing calibration-free eye-tracking for foveated rendering.