Gaze tracking is a powerful capability that is appearing in an increasing number of devices, most recently in Microsoft Hololens. In 2013, the SimInsights team worked with SRI (Princeton, NJ) in response to interest from DARPA (Defense Advanced Research Projects Agency) for training players to use gaze control to improve situational awareness. A key measures of interest was decreased reaction time (how to take in more information in less time). Examples of such processing may include detection of intentions of agents, recognizing objects, emotions, actions etc. Increased visual-spatial workspace was another area of interest. How can players enhance their ability to selectively pay attention to both foveal and peripheral fields of view and potentially even enlarge the functional field of view. How to use gaze control to monitor other's gaze, posture, gestures and behaviors and thus monitor their attention, engagement and interest, anticipate future unfolding of interactions based on holistic understanding of interaction in space and time etc. Finally, use gaze control to engage in cooperative interaction so as to influence other's attention, engagement and interest.


  • Gaze as input is remarkably unobtrusive and efficient compared to other forms of input.
  • Gaze can reveal rich behavioural and intent information about users.
  • Gaze tracking can yield insights into users affective and cognitive states.
  • Gaze based games can be far more interactive than other games.
  • Gaze input can be supplemented with other inputs to make content multimodal.