Gaze Tracking - Gaze based human-computer interaction

Gaze Tracking

Gaze tracking is a powerful capability that is appearing in an increasing number of devices, most recently in Microsoft Hololens. In 2013, the SimInsights team worked with SRI (Princeton, NJ) in response to interest from DARPA (Defense Advanced Research Projects Agency) for training players to use gaze control to improve situational awareness. A key measures of interest was decreased reaction time (how to take in more information in less time). Examples of gaze tracking may include detection of intentions of agents, recognizing objects, emotions, actions etc. Increased visual-spatial workspace was another area of interest. How can players enhance their ability to selectively pay attention to both foveal and peripheral fields of view and potentially even enlarge the functional field of view. How to use gaze control to monitor other’s gaze, posture, gestures and behaviors and thus monitor their attention, engagement and interest, anticipate future unfolding of interactions based on holistic understanding of interaction in space and time etc. Finally, use gaze control to engage in cooperative interaction so as to influence other’s attention, engagement and interest.