4 System control in applications
4.4 Eye tracking (PC mouse control, navigation between options in screen)

Eye tracking option for mouse control has emerged in recent years as an accessibility option when controlling the PC. It is integrated already in some operation systems e.g. in Windows 10 from Microsoft.

Windows 10 supports specific eye tracking hardware. Some key capabilities can be controlled via Eye movement. These capabilities are focused on accessing applications, entering information, and communicating. The basic Windows 10 Eye Control user interface (UI) element is the launchpad, which allows users to simply look at icons to access the mouse, keyboard, and text-to-speech features as well as to move the launchpad to the top or bottom of the display. Interacting with the Eye Control UI is simple but requires some practice: just look at the screen and focus, or “dwell” as Microsoft calls it, on a button or other element until it engages. The system provides feedback throughout that lets you know what you’re doing.

As replacement for the mouse and general user the precision of the systems is not enough, but in cases for user with special needs, who magnifies the screen and slower operation is not issue, this can be great choice.

When used for control in games that doesn’t require the fine control of a first-person shooter, the player can achieve very immersive experience, navigating simply by looking at where the player wants to go. Camera can allow the player to look where he wants or focus on a specific character. In such situations the player could feel like to be in the game.

There are many more application areas, not only computer control. E.g. currently being developed eye tracking technology named ‘wearable cockpit’, for the future fighter jets will provide fighter jet pilots with a virtual display projected through the helmet. It will enable pilots to quickly access, assess and act on critical information, providing easy control on the cockpit of the aircraft. E.g. just by looking at something it can be highlighted it and then by making a gesture to ‘press’ it can be pressed.

There are also some programs that track using notebook camera the position of the head and use it for the mouse control (e.g. iTracker).