Introduction to Augmented Reality in Airport Control Towers
The concept of an augmented reality human–machine interface (AR HMI) for airport control towers was initially explored within the RETINA research project. This project laid the groundwork for further investigation into the usage of AR HMI in airport control towers, which is currently being conducted throughout the SESAR JU Digital Technologies for Towers (DTT) industrial research project. The DTT project focuses on developing modern solutions for tower operations, constructing upon the findings of the RETINA project.
Development of Virtual/Augmented Reality Applications
As a part of the DTT project, a particular focus was given to the event of Virtual/Augmented Reality Applications for Tower Operations. The objective of this solution was to refine and expand upon the findings of the RETINA validation campaign, addressing several identified research gaps. These gaps included the necessity for multi-user operations, understanding the impact of the shift in visibility conditions on ATCOs tasks, and exploring various interaction options, including multimodal interaction.
Integration of Additional Features
This paper presents the mixing of additional features not previously considered on the exploratory research stage. These features include adaptive Human–Machine Interface (HMI) and dealing positions, multimodal interaction, and safety nets visualization. The integration of those features goals to boost controller productivity and situational awareness, while also improving safety in airport control towers.
Exercise Objectives
The exercise aimed to attain several outcomes, including:
- Providing consistent visual conditions for tower controllers in all weather conditions through the usage of Virtual and Augmented Reality technologies with head-up interfaces.
- Enhancing controller productivity and situational awareness by minimizing the necessity to modify between head-up and head-down positions.
- Facilitating more natural and efficient interaction in tower control operations through the implementation of air gestures.
- Improving safety by displaying perceptual cues that direct controllers’ attention to specific events.
Validation Campaign
To validate these hypotheses and address the gaps identified by RETINA, a validation campaign was conducted using the simulated scenarios of Bologna International Airport (LIPE). Bologna airport is provided with Primary and Secondary Surveillance RADAR, Surface Movement Radar, and Instrumental Landing System CAT 3B, making it a super location for testing the AR HMI solution.
Airport Layout and Low Visibility Procedures
Bologna airport has a moderately complex layout, with one runway, several taxiways, and multiple apron. The airport also has a fundamental taxiway T and a number of other taxiway and aircraft stand taxilanes. Low Visibility Procedures (LVP) are implemented at Bologna airport, which include three visibility conditions: CONDI VIS 1, CONDI VIS 2, and CONDI VIS 3. These conditions dictate the operational rules and dealing methods of the ATCOs, with a concentrate on ensuring safety in low visibility conditions.
Technical Solution
The technical solution implemented within the validation campaign included the usage of see-through head-mounted smart glasses for the viewing of holograms integrated inside a real-world environment. The solution had three different associated functions: Tracking Labels (TL), Air Gesture (AG) interaction, and Safety Nets (SN). Each feature was evaluated against baseline equipment, with the goal of enhancing controller productivity and situational awareness.
Tracking Labels and Air Gesture Interaction
The Tracking Labels feature provided digital details about aircraft, including call sign, aircraft type, and standing. The Air Gesture interaction feature allowed controllers to issue clearances to pilots using hand gestures. These features were designed to cut back the necessity for head-down operations and improve controller productivity.
Safety Nets Visualization
The Safety Nets visualization feature displayed perceptual cues to direct controllers’ attention to specific events, equivalent to potential collisions or weather hazards. This feature aimed to enhance safety in airport control towers by providing controllers with real-time details about potential hazards.
Conclusion
The integration of augmented reality and virtual reality technologies in airport control towers has the potential to boost controller productivity and situational awareness, while also improving safety. The validation campaign conducted at Bologna International Airport demonstrated the effectiveness of the AR HMI solution in providing consistent visual conditions, facilitating natural and efficient interaction, and improving safety. As the aviation industry continues to evolve, the usage of AR HMI solutions is more likely to grow to be increasingly necessary in ensuring the secure and efficient operation of airport control towers.
