收藏切换
Artificial intelligence-assisted flight technologies for single-pilot operations: a comprehensive review
收藏切换
Lin Yuan1, Yang Li2, 3, Yanfei Miao4, Xiaoyang Li5, Congqi Cao1, *
Journal of Image and Graphics | 2026, 31(9) : 3227 - 3250
Less
收藏切换
Journal of Image and Graphics | 2026, 31(9): 3227-3250
• The intelligent empowerment of large models in the aviation field •
Artificial intelligence-assisted flight technologies for single-pilot operations: a comprehensive review
Full
Lin Yuan1, Yang Li2, 3, Yanfei Miao4, Xiaoyang Li5, Congqi Cao1, *
Affiliations
  • 1 School of Computer Science,Northwestern Polytechnical University,Xi’an 710129,China
  • 2 Shenyang Aircraft Design and Research Institute,Shenyang 110035,China
  • 3 National Elite Institute of Engineering,Northwestern Polytechnical University, Xi’an 710072,China
  • 4 School of Aerospace Engineering,Tsinghua University,Beijing 100084,China
  • 5 School of Electronics and Information,Northwestern Polytechnical University,Xi’an 710129,China
Published: 2026-09-16 doi: 10.11834/jig.260216
Outline
收藏切换

Today,the aviation industry faces a critical shortage of qualified pilots and escalating labor costs due to the continuous surge in global air transport demand. Consequently,single-pilot operation (SPO) has emerged as a strategic evolution in civil aviation to optimize crew resources and mitigate pilot fatigue,especially during long-haul flights. However,the transition from traditional multicrew cockpits to a single-pilot environment is not merely a reduction in personnel; rather,it introduces a significant “cognitive and decision-making gap” previously filled by the co-pilot. To bridge this gap,this paper proposes the concept of the “AI co-pilot” —— an intelligent system designed to establish a deep cognitive collaborative relationship with the human pilot through advanced perception,semantic understanding,and autonomous decision-making capabilities. This paper provides a systematic and comprehensive review of the core technological components enabling AI-assisted piloting. In this work,we propose a four-layer analytical framework known as “perception-cognition-interaction-decision-safety monitoring”. This structure serves as a blueprint for integrating heterogeneous AI modules into the high-integrity environment of an aircraft cockpit. First,we look into multimodal physiological and behavioral sensing technologies that are essential for the real-time monitoring of a pilot’s workload and fatigue state. Given that traditional subjective assessments are insufficient for high-dynamic flight environments,this review focuses on the integration of electroencephalogram (EEG) and functional near-infrared spectroscopy (fNIRS). In particular,we provide a critical analysis of their trade-offs: while EEG offers superior temporal resolution capable of capturing instantaneous cognitive shifts,fNIRS demonstrates stronger robustness against motion artifacts in a vibrating cockpit. Furthermore,computer vision (CV) techniques are discussed for the nonintrusive monitoring of facial expressions,percentage of eyelid closure (PERCLOS),and visual tunneling effects. The fusion of these modalities allows the AI Co-pilot to “read” the pilot’s state and trigger adaptive automation upon detection of cognitive overload. Second,the review explores intelligent speech interaction and semantic understanding within the complex controller-pilot data link communications (CPDLC) and radio environments. The aviation context poses unique challenges,including low signal-to-noise ratios in VHF communications and nonstandard accents. In this paper,we analyze the application of LLMs and transformer-based architectures in intent recognition and slot filling for air traffic control (ATC) instructions. By parsing complex,nested instructions into executable parameters,the AI Co-pilot functions as an “intelligent radio operator” that significantly reduces the auditory and manual workload of the single pilot. Third,we summarize intelligent route planning and dynamic conflict resolution driven by the synergy of large models and deep reinforcement learning (DRL). Algorithms such as proximal policy optimization (PPO) and soft actor-critic (SAC) are evaluated for their efficacy in continuous action spaces and high-dimensional flight dynamics. Unlike traditional rule-based flight management systems (FMS),AI-driven planners can explore optimal trajectories in unconstrained airspace and respond adaptively to extreme weather or system failures. Additionally,we emphasize the transition from individual agent optimization to multiagent reinforcement learning (MARL) for collaborative collision avoidance in dense urban air mobility (UAM) scenarios. A significant portion of this review is dedicated to the core barriers that hinder the commercial deployment of aviation AI. We provide an in-depth analysis of the non-interpretability of “black-box” deep learning models,which prevents human pilots from establishing calibrated trust during time-critical emergencies. Furthermore,the paradigm conflict between the nondeterministic nature of AI and traditional deterministic airworthiness standards (e.g.,DO-178C) is dissected. We also discuss the latest policy trends from EASA and the FAA,highlighting the shift toward “run-time assurance (RTA)” frameworks. Specifically,RTA acts as a safety shield,bounding the outputs of complex AI models within a predefined safe flight envelope and ultimately providing a viable certification pathway. Finally,this paper presents a perspective on future trends. We posit that the next generation of aviation AI will evolve toward a “multimodal unified architecture” in which text,speech,vision,and flight dynamics are aligned in a single latent space. We predict that this evolution will transform the AI Co-pilot from a collection of isolated subtasks into a holistic “cognitive partner”. By emphasizing transparency,bidirectional communication,and standardized certification,this review aims to provide a theoretical foundation and engineering reference for achieving high-transparency,deep human-machine collaborative intelligent cockpits in the SPO era.

artificial intelligence (AI)  /  AI co-pilot  /  pilot state awareness  /  intelligent speech interaction  /  deep reinforcement learning
袁林, 李阳, 苗延飞, 李枭扬, 曹聪琦. 人工智能辅助的单机长飞行驾驶技术综述. 中国图象图形学报, 2026 , 31 (9) : 3227 -3250 . DOI: 10.11834/jig.260216
Lin Yuan, Yang Li, Yanfei Miao, Xiaoyang Li, Congqi Cao. Artificial intelligence-assisted flight technologies for single-pilot operations: a comprehensive review[J]. Journal of Image and Graphics, 2026 , 31 (9) : 3227 -3250 . DOI: 10.11834/jig.260216
  • National Natural Science Foundation of China (62376217,62576279,62301434);Young Elite Scientists Sponsorship Program by CAST(2023QNRC001)
Year 2026 volume 31 Issue 9
17
7
Cite this Article
BibTeX
Article Info
doi: 10.11834/jig.260216
  • Receive Date:2026-04-16
  • Online Date:2026-10-30
  • Published:2026-09-16
Article Data
Affiliations
History
  • Received:2026-04-16
  • Revised:2026-05-19
Funding
National Natural Science Foundation of China (62376217,62576279,62301434);Young Elite Scientists Sponsorship Program by CAST(2023QNRC001)
Affiliations
    1 School of Computer Science,Northwestern Polytechnical University,Xi’an 710129,China
    2 Shenyang Aircraft Design and Research Institute,Shenyang 110035,China
    3 National Elite Institute of Engineering,Northwestern Polytechnical University, Xi’an 710072,China
    4 School of Aerospace Engineering,Tsinghua University,Beijing 100084,China
    5 School of Electronics and Information,Northwestern Polytechnical University,Xi’an 710129,China
References
Share
https://castjournals.cast.org.cn/joweb/zgtxtxxb/EN/10.11834/jig.260216
Share to
QR

Scan QR to access full text

Cite this article
BibTeX
Citations
表12种不同金属材料的力学参数
科
Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)
属
Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏
  • BibTeX
  • EndNote
  • RefWorks
  • TxT