Gaze tracking is a powerful capability that is appearing in an increasing number of devices,
most recently in Microsoft Hololens. In 2013, the SimInsights team worked with SRI (Princeton, NJ) in response to interest from DARPA
(Defense Advanced Research Projects Agency) for training players to use gaze control to improve situational awareness. A key measures
of interest was decreased reaction time (how to take in more information in less time). Examples of such processing may include detection
of intentions of agents, recognizing objects, emotions, actions etc. Increased visual-spatial workspace was another area of interest. How
can players enhance their ability to selectively pay attention to both foveal and peripheral fields of view and potentially even enlarge
the functional field of view. How to use gaze control to monitor other’s gaze, posture, gestures and behaviors and thus monitor their
attention, engagement and interest, anticipate future unfolding of interactions based on holistic understanding of interaction in space
and time etc. Finally, use gaze control to engage in cooperative interaction so as to influence other’s attention, engagement and interest.


  • Gaze as input is remarkably unobtrusive and efficient compared to other forms of input.
  • Gaze can reveal rich behavioural and intent information about users.
  • Gaze tracking can yield insights into users affective and cognitive states.
  • Gaze based games can be far more interactive than other games.
  • Gaze input can be supplemented with other inputs to make content multimodal.