The first dedicated precision eye-tracking system for flight crew training in a Full Flight Simulator (FFS)

Over shoulder view of pilot Aircraft HUD


The global aviation market is growing at a significant rate. As the global commercial fleet is expected to double within 20 years, air traffic will steadily increase, and a pilot shortage is expected.

Boeing expects nearly 700,000 new pilots will be required between 2018-2037 to satisfy increasing air travel demands

This means that pilot training systems are on the brink of unprecedented pressure and efficiency expectations. Coupled with an increasing demand for innovation in the industry, arises the problematic challenges of advancing autonomy while retaining manual control skills.

This all points to an urgent need to improve training effectiveness, especially within performance monitoring. National regulators and transport safety experts recognise that poor flight path monitoring is a major contributor to aircraft accidents, incidents, and near misses. 

Poor monitoring issues are involved in >50% of accidents and incidents – ICAO 1994, NTSB 1994, CAA 2000

As aircrew monitor increasingly complex systems and depend on progressive levels of automation, efficient scanning is critically important to situational awareness. 

Seeing Machines’ deep experience with aviation training organisations, carriers and operators provides us with better understanding of the pilot state, flightpath monitoring, instrument scanning, and situational awareness. We have learned that the primary method for assessing pilot and trainee scanning and monitoring functions is through instructor observation and interpretation.


Seeing Machines’ Crew Training System helps overcome gaps in traditional flight simulator training by enabling instructors to directly understand pilot behaviour, decision-making patterns, scanning, and attention levels in real time.

Seeing Machines’ Crew Training System is the first dedicated precision eye-tracking system for flight crew training in the Full Flight Simulator (FFS) environment. Crew Training System is a single and/or multi-crew eye-tracking solution designed to support instructors’ objective assessment of aircrew active monitoring, and provide the instructor with scanning evidence to support their real-time assessment requirements, as well as trainee debriefing requirements.

Read about the benefits of integrating eye-tracking capabilities with HUD (Head-Up Display) for pilot training systems – co-authored by Captain Matthew Gray, Alexander Robinson and Rama Myers.


Seeing Machines


Crew Training System is suited for data and evidence driven flight training organisations, who invest in the performance of their instructors, trainees, and flight operations. Crew Training System enables instructors to quickly and easily assess where pilots are looking during target scenarios with the relevant context, and provide feedback and guidance to trainees on optimal performance.

Crew Training System is designed to complement the existing workflow of instructors and has been validated in representative FFS training environments. Crew Training System provides information to support evidence-based and competency-based training and assessment, and strengthens the reputation of flight training organisations through relevant, reliable and factual pilot attention data.

Crew Training System Features

CandyBar™ Time Plot Tracking – The CandyBar dashboard allows instructors to “see” how aircrew divide their attention over time and monitoring function.

High Fidelity Tracking –
Calibrated and precision eye-gaze tracking provides reliable attention results against instruments and areas-of-interest, including through HUD/HGS.

Real-time Scanning View –
Instructors can identify scanning breakdowns in real-time, and annotate events for debrief.

Debrief Scanning Replay –
Instructors can replay scanning behaviors to pilots. 

Synchronise with Simulator Performance Data (SPD) –
Synchronise crew attention data with audio, visual, actions, and SPD/SOQA data to add context to scenarios.

Objective Evidence –
Enhance data driven Evidence-Based Training (EBT) practices. 

Real-World Conditions –
Safe and near-invisible IR illumination provides complete and reliable eye- and head-tracking at night, in-motion, and through glasses or visors.

Scenario-Specific Training –
Load, create, and record specific flight training scenarios, and annotate accordingly.

Platform Agnostic –
Installed as a retro-fit or forward-fit configuration.

Modular, Discreet Packaging & Installation – Custom-designed and packaged installation for each cockpit, Crew Training System is engineered for functional but discreet installation.