Strategies to Manage Human Factors in Mixed Reality Pilot Training: A Survey

2025-07-21

AI Summary

This study addresses human factors challenges—including motion sickness, visual fatigue, and ergonomic discomfort—associated with mixed reality (MR) head-mounted displays in pilot training, and examines their potential impact on training efficacy and aviation safety. Methodologically, it innovatively integrates international civil aviation regulatory standards (e.g., EASA/FAA airworthiness and simulation certification requirements) into a human factors evaluation framework, combining systematic literature review with regulatory text analysis to assess multi-level mitigation strategies: hardware/software design improvements, physiological and psychological interventions, and operational procedure optimization. The study proposes a comprehensive MR flight training implementation framework that balances technical feasibility, pilot well-being, and regulatory compliance. It identifies actionable human factors management pathways, thereby providing theoretical foundations and policy support for developing industry-wide MR training guidelines, certification criteria, and evidence-based best practices.

Technology Category

• Cognitive Modeling & Cognitive Systems: Simulating Human Behavior
• Application Domains: Mobility, Driving & Flight
• Humans and AI: Planning and Decision Support for Human-Machine Teams

Application Category

• Responsible Web: Machine-in-the-loop, human agency and autonomy
• User Modeling, Personalization and Recommendation: Accountability, Transparency, and Ethics for personalization
• Search and Retrieval-Augmented AI: Web evaluation methodologies and metrics

Abstract

Mixed Reality (MR) head mounted displays (HMDs) offer a promising alternative to traditional Flight Simulator Training Device (FSTD) displays, providing immersion, realism and cost efficiency. However, these technologies require management of human factors; cybersickness, visual fatigue and ergonomic strain. If left unmitigated, these effects can hinder pilot performance and training outcomes. For safety critical fields like aviation, addressing human factors challenges is crucial for MR's training potential. This survey systematically reviews the current literature identifying key human factors challenges in MR HMD use in pilot training and examines strategies to mitigate these barriers. Drawing on existing industry standards set by a leading aviation authority, the review adopts a regulatory perspective to explore hardware, software, ergonomic, physiological and psychological interventions improving pilot comfort, safety and training effectiveness in an MR FSTD. Additionally, it evaluates which of these interventions are most appropriate and viable for MR pilot training under existing aviation training regulations, ensuring that technical requirements and pilot wellbeing remain balanced. The findings yield significant insights for the human dimensions of aviation simulation training, highlighting how regulatory considerations shape the practicality of mitigation measures. These insights inform emerging MR aviation training guidelines and best practices, supporting MR's readiness to enhance aviation training.

Problem

• Address human factors in MR pilot training
• Mitigate cybersickness, visual fatigue, ergonomic strain
• Balance technical requirements with pilot wellbeing

Innovation

• MR HMDs enhance pilot training with immersion
• Mitigate cybersickness, fatigue via ergonomic interventions
• Align strategies with aviation regulatory standards