Home Journals Articles Updates About
CN
image
收藏切换
Detection of pilots' cognitive states based on cross-modal physiological signal fusion
收藏切换
PDF
Wenze Zhang1, Zaijun Wang2, Yuheng Jiang2, Ruizhe Yang2
Electronic Measurement Technology | 2026, 49(6) : 146 - 155
Less
收藏切换
Electronic Measurement Technology | 2026, 49(6): 146-155
• Data Acquisition and Signal Processing •
Detection of pilots' cognitive states based on cross-modal physiological signal fusion
Full
Wenze Zhang1, Zaijun Wang2, Yuheng Jiang2, Ruizhe Yang2
Affiliations
  • 1.College of Air Traffic Management, Civil Aviation Flight University of China, Guanghan 618307, China
  • 2.Key Laboratory of Flight Techniques and Flight Safety, Civil Aviation Flight University of China, Guanghan 618307, China
doi: 10.19651/j.cnki.emt.2519375
Outline
收藏切换

Accurate assessment of pilot cognitive states is critical for ensuring flight safety, yet existing methods exhibit limitations in fusing multimodal physiological signals. To address this, this paper proposes a dual-stream deep learning network based on bidirectional cross-modal attention. The model adopts a parallel dual-branch architecture: The electroencephalography (EEG) branch quantifies brain functional connectivity through phase locking value (PLV) features and employs a densely connected network enhanced with squeeze-and-excitation (SE) modules for deep feature extraction; the electrocardiogram (ECG) branch extracts heart rate variability (HRV) and waveform features, processed by a residual-connected multilayer perceptron to characterize autonomic nervous system activity. Building upon this, an innovatively designed bidirectional cross-modal attention module dynamically weights and fuses the dual-path deep features to achieve precise classification of three states—concentrated attention, distracted attention, and startle/surprise. Experimental results on the NASA public dataset demonstrate an overall recognition accuracy of 97.44%. Ablation and comparative analyses confirm that the fusion strategy significantly outperforms single-modality analysis and simple feature concatenation methods. The study reveals that deep integration of EEG functional connectivity and ECG physiological information via attention mechanisms effectively enhances cognitive state recognition performance. This approach provides reliable technical support for developing objective and efficient pilot state monitoring systems, holding significant application value for improving flight safety.

cognitive state recognition  /  flight safety  /  cross-modal attention  /  electroencephalography  /  deep learning
Wenze Zhang, Zaijun Wang, Yuheng Jiang, Ruizhe Yang. Detection of pilots' cognitive states based on cross-modal physiological signal fusion[J]. Electronic Measurement Technology, 2026 , 49 (6) : 146 -155 . DOI: 10.19651/j.cnki.emt.2519375
Appendix
Less
Year 2026 volume 49 Issue 6
PDF
23
5
Cite this Article
BibTeX
Article Info
doi: 10.19651/j.cnki.emt.2519375
  • Receive Date：2025-07-16
  • Online Date：2026-05-15
Article Data
Affiliations
History
  • Received：2025-07-16
Funding
Affiliations
    1.College of Air Traffic Management, Civil Aviation Flight University of China, Guanghan 618307, China
    2.Key Laboratory of Flight Techniques and Flight Safety, Civil Aviation Flight University of China, Guanghan 618307, China
References
Share
https://castjournals.cast.org.cn/joweb/dzcljs/EN/10.19651/j.cnki.emt.2519375
Share to
QR

Scan QR to access full text

Cite this article
BibTeX
Citations
表12种不同金属材料的力学参数
科
Family		 属数
Number of
genus		 种数
Number of
species		 占总种数比例
Percentage of
total species (%)		 属
Genus		 种数
Number of
species		 占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏
  • BibTeX
  • EndNote
  • RefWorks
  • TxT
Links
Articles
Latest Articles
Most Read
Collections
Updates
Events
News
Multimedia
About
About Us
Contact
No. 86 Xueyuan South Road, Haidian District, Beijing
100081
010-62199257
qkjq@cast.org.cn

Copyright © 2025 China Association for Science and Technology. All rights reserved. For all open access content, the relevant licensing terms apply.
Sponsored by the Office of the Leading Group for Cybersecurity and Informatization of CAST, and supported by Science and Technology Review Publishing House