Thursday, November 21, 2024

Analyzing Pilot Performance and Mental Load in Augmented Reality Using a New Tool

Share

Revolutionizing Pilot Training with HuBar: A Novel Visual Analytics Tool for AR-Assisted Learning

NYU Tandon School of Engineering has developed a groundbreaking visual analytics tool called HuBar, designed to revolutionize AR-assisted training programs for pilots and beyond. By analyzing performer behavior and cognitive workload, HuBar provides deep insights into mental states, enabling trainers to optimize training programs for improved learning outcomes and real-world performance.

The research team will present HuBar at the 2024 IEEE Visualization and Visual Analytics Conference, showcasing its capabilities in analyzing data from AR-guided simulated flights. With applications beyond aviation, HuBar has the potential to enhance training in surgery, military operations, and industrial tasks, making it a versatile tool for improving performance across various complex scenarios.

By integrating multiple streams of complex data, including brain activity, body movements, gaze tracking, and task procedures, HuBar offers a holistic analysis of performer behavior in AR-assisted tasks. This comprehensive approach allows for a detailed understanding of cognitive states, physical actions, and task performance, leading to tailored AR assistance systems that meet the needs of individual users.

As AR systems become more sophisticated and widespread, tools like HuBar will play a crucial role in understanding how these technologies impact human performance and cognitive load. With the support of a $5 million DARPA contract, the NYU research group aims to develop AI technologies that enhance task performance and reduce errors, ultimately making users more versatile and proficient in complex tasks.

HuBar represents a significant advancement in the field of visual analytics, offering researchers and trainers a powerful tool for optimizing AR-assisted training programs and improving learning outcomes across a wide range of applications. Its ability to provide detailed insights into performer behavior and mental states sets it apart as a valuable asset in the high-stakes world of aviation and beyond.

Read more

Local News