Embedded vision systems are being used to track human eye movements and determining, which is improving virtual reality (VR) applications.
Embedded vision systems are constantly being put in new environments in new applications to enhance the capabilities of existing systems. Most recently, embedded vision systems are being used to tackle the complex process of tracking human eye movements and determining what has our attention.
Whether it’s how long the eye fixates on something, where the eye is looking, or what features attract the gaze of the eye, embedded vision systems are uniquely equipped to interpret the activity of the eye.
The most immediate application for improved eye tracking is virtual reality (VR). Fast image capture with synchronized cameras must be achieved in a very compact space. This is so that the VR user doesn’t detect a lag between where their eyes are moving and how the virtual environment around them is moving. This undermines the entire illusion of VR.
Embedded vision technology is fundamentally important in enabling foveated rendering – a digital display technique in which the point where the eyes are focused is sharpened and the rest is blurred, mimicking the way natural eyesight works. Foveated rendering is important not only for accurate renderings, but because it reduces the load on the graphics processing unit (GPU), allowing for much higher quality displays and frame rates at lower costs and energy consumption.
Embedded vision capabilities for virtual reality
Embedded visions systems today, despite their small size and streamlined design, are capable of achieving high frame rates for VR eye tracking. This is a critical performance parameter, as many frames need to be captured to accurately analyze the subtlety of human eye movements. This is a delicate application requiring high performance vision.
Further, image processing must occur at high speeds to analyze all of these frames and inform a VR system to respond to rapid eye movements in real time. Whether this is through the use of GPUs or FPGAs for processing, VR presents demanding requirements for processing that must be completed for accurate imaging.
VR is a cutting-edge application that demands the most advanced and innovative embedded vision systems. While VR has a long road to achieving its full potential, embedded vision systems are enabling improvements at every step of the way.
This article originally appeared in Vision Online. AIA is a part of the Association for Advancing Automation (A3), a CFE Media content partner. Edited by Chris Vavra, production editor, CFE Media, [email protected].
