Article(id=1262079399604699418, tenantId=1146029695717560320, journalId=1260987750510510108, issueId=1262079396291141802, articleNumber=null, orderNo=null, doi=10.19651/j.cnki.emt.2519375, pmid=null, cstr=null, oa=null, hot=null, price=null, onlineType=0, articleFormat=0, articleType=null, articleTypeStr=null, receivedDate=1752595200000, receivedDateStr=2025-07-16, revisedDate=null, revisedDateStr=null, acceptedDate=null, acceptedDateStr=null, onlineDate=1778832777166, onlineDateStr=2026-05-15, pubDate=null, pubDateStr=null, doiRegisterDate=null, doiRegisterDateStr=null, onlineIssueDate=1778832777166, onlineIssueDateStr=2026-05-15, onlineJustAcceptDate=null, onlineJustAcceptDateStr=null, onlineFirstDate=null, onlineFirstDateStr=null, sourceXml=null, magXml=null, createTime=1778832777166, creator=13701087609, updateTime=1778832777166, updator=13701087609, issue=Issue{id=1262079396291141802, tenantId=1146029695717560320, journalId=1260987750510510108, year='2026', volume='49', issue='6', pageStart='1', pageEnd='256', issueExtLink='null', onlineDate='null', pubDate='null', beforeIssueId=null, nextIssueId=null, price=null, status=1, issueComplete=1, articleOrder=1, issueType=1, specialIssue=null, createTime=1778832776377, creator=13701087609, updateTime=1778832914473, updator=13701087609, preIssue=null, nextIssue=null, ext={EN=IssueExt(id=1262079975688122904, tenantId=1146029695717560320, journalId=1260987750510510108, issueId=1262079396291141802, language=EN, specialIssueTitle=, coverIllustrator=null, specialIssueEditor=, specialIssueAbout=), CN=IssueExt(id=1262079975688122905, tenantId=1146029695717560320, journalId=1260987750510510108, issueId=1262079396291141802, language=CN, specialIssueTitle=, coverIllustrator=null, specialIssueEditor=, specialIssueAbout=)}, issueFiles=null}, startPage=146, endPage=155, ext={EN=ArticleExt(id=1262079401701851438, articleId=1262079399604699418, tenantId=1146029695717560320, journalId=1260987750510510108, language=EN, title=Detection of pilots' cognitive states based on cross-modal physiological signal fusion, columnId=1262079401135583379, journalTitle=Electronic Measurement Technology, columnName=Data Acquisition and Signal Processing, runingTitle=null, highlight=null, articleAbstract=

Accurate assessment of pilot cognitive states is critical for ensuring flight safety, yet existing methods exhibit limitations in fusing multimodal physiological signals. To address this, this paper proposes a dual-stream deep learning network based on bidirectional cross-modal attention. The model adopts a parallel dual-branch architecture: The electroencephalography (EEG) branch quantifies brain functional connectivity through phase locking value (PLV) features and employs a densely connected network enhanced with squeeze-and-excitation (SE) modules for deep feature extraction; the electrocardiogram (ECG) branch extracts heart rate variability (HRV) and waveform features, processed by a residual-connected multilayer perceptron to characterize autonomic nervous system activity. Building upon this, an innovatively designed bidirectional cross-modal attention module dynamically weights and fuses the dual-path deep features to achieve precise classification of three states—concentrated attention, distracted attention, and startle/surprise. Experimental results on the NASA public dataset demonstrate an overall recognition accuracy of 97.44%. Ablation and comparative analyses confirm that the fusion strategy significantly outperforms single-modality analysis and simple feature concatenation methods. The study reveals that deep integration of EEG functional connectivity and ECG physiological information via attention mechanisms effectively enhances cognitive state recognition performance. This approach provides reliable technical support for developing objective and efficient pilot state monitoring systems, holding significant application value for improving flight safety.

, correspAuthors=null, authorNote=null, correspAuthorsNote=null, copyrightStatement=null, copyrightOwner=null, extLink=null, articleAbsUrl=null, sourceXml=null, magXml=null, pdfUrl=null, pdf=null, pdfFileSize=null, pdfExtLink=null, richHtmlUrl=null, mobilePdfUrl=null, reviewReport=null, pdfFirstPage=null, abstractGraph=null, abstractGraphContent=null, abstractVideo=null, citation=null, cebUrl=null, magXmlContent=null, mapNumber=null, authorCompany=null, fund=null, authors=null, authorsList=Wenze Zhang, Zaijun Wang, Yuheng Jiang, Ruizhe Yang), CN=ArticleExt(id=1262079406399471957, articleId=1262079399604699418, tenantId=1146029695717560320, journalId=1260987750510510108, language=CN, title=基于跨模态生理信号融合的飞行员认知状态检测, columnId=1262079401831837846, journalTitle=电子测量技术, columnName=数据采集及信号处理, runingTitle=null, highlight=null, articleAbstract=

飞行员认知状态的精准评估对保障飞行安全至关重要,然而现有方法在多模态生理信号融合上存在局限性。为此,本文提出一种基于双向跨模态注意力的双流深度学习网络。该模型采用并行双分支架构:脑电(EEG)分支通过相位锁定值(PLV)量化大脑功能连接,并采用SE模块增强的密集连接网络进行深度特征提取;心电(ECG)分支则提取心率变异性(HRV)及波形特征,经残差连接多层感知机处理以表征自主神经系统活动。在此基础上,通过创新设计的双向跨模态注意力模块,动态加权融合双路深度特征,实现对注意力集中、分散和惊吓/惊奇3种状态的精准分类。在NASA公开数据集上的实验表明,模型总体识别准确率达97.44%。消融与对比分析证实,该融合策略显著优于单模态分析和简单的特征拼接方法。研究表明,通过注意力机制深度融合EEG功能连接与ECG生理信息,可有效提升认知状态识别性能,该方法为开发客观、高效的飞行员状态监测系统提供了可靠的技术支持,对提升飞行安全具有重要的应用价值。

, correspAuthors=null, authorNote=null, correspAuthorsNote=
王在俊(通信作者),研究员,硕士生导师,主要研究方向为飞行技术与飞行安全、智能计算。E-mail:
, copyrightStatement=null, copyrightOwner=null, extLink=null, articleAbsUrl=null, sourceXml=JI62zH7bYyRVuUb3mmeQyA==, magXml=6/OVTA+A8+RR35VtEH3fQg==, pdfUrl=null, pdf=rsrPIWj+4YJYNFKM3TUfNQ==, pdfFileSize=5479025, pdfExtLink=null, richHtmlUrl=null, mobilePdfUrl=null, reviewReport=null, pdfFirstPage=null, abstractGraph=null, abstractGraphContent=null, abstractVideo=null, citation=null, cebUrl=null, magXmlContent=4vza55ZEwfPuCimD71Tyaw==, mapNumber=null, authorCompany=null, fund=null, authors=

张文泽,硕士,主要研究方向为生理信号处理及其在飞行安全领域的识别应用。E-mail:

蒋宇恒,硕士,主要研究方向为生理信号处理及其在飞行安全领域的识别应用。E-mail:

杨睿哲,硕士,主要研究方向为生理信号处理及其在飞行安全领域的识别应用。E-mail:

, authorsList=张文泽, 王在俊, 蒋宇恒, 杨睿哲)}, authors=[Author(id=1262079409251598722, tenantId=1146029695717560320, journalId=1260987750510510108, articleId=1262079399604699418, orderNo=0, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=skzwz@qq.com, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1262079409746526607, tenantId=1146029695717560320, journalId=1260987750510510108, articleId=1262079399604699418, authorId=1262079409251598722, language=EN, stringName=Wenze Zhang, firstName=Wenze, middleName=null, lastName=Zhang, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, address=1.College of Air Traffic Management, Civil Aviation Flight University of China, Guanghan 618307, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1262079410149179805, tenantId=1146029695717560320, journalId=1260987750510510108, articleId=1262079399604699418, authorId=1262079409251598722, language=CN, stringName=张文泽, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, address=1.中国民用航空飞行学院空中交通管理学院 广汉 618307, bio={"content":"

张文泽,硕士,主要研究方向为生理信号处理及其在飞行安全领域的识别应用。E-mail:

"}, bioImg=null, bioContent=

张文泽,硕士,主要研究方向为生理信号处理及其在飞行安全领域的识别应用。E-mail:

, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1262079407863284072, tenantId=1146029695717560320, journalId=1260987750510510108, articleId=1262079399604699418, xref=1., ext=[AuthorCompanyExt(id=1262079407880061289, tenantId=1146029695717560320, journalId=1260987750510510108, articleId=1262079399604699418, companyId=1262079407863284072, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1.College of Air Traffic Management, Civil Aviation Flight University of China, Guanghan 618307, China), AuthorCompanyExt(id=1262079408479846766, tenantId=1146029695717560320, journalId=1260987750510510108, articleId=1262079399604699418, companyId=1262079407863284072, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1.中国民用航空飞行学院空中交通管理学院 广汉 618307)])]), Author(id=1262079410849628586, tenantId=1146029695717560320, journalId=1260987750510510108, articleId=1262079399604699418, orderNo=1, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=zaijunwang@cafuc.edu.cn, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1262079411747209651, tenantId=1146029695717560320, journalId=1260987750510510108, articleId=1262079399604699418, authorId=1262079410849628586, language=EN, stringName=Zaijun Wang, firstName=Zaijun, middleName=null, lastName=Wang, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=2, address=2.Key Laboratory of Flight Techniques and Flight Safety, Civil Aviation Flight University of China, Guanghan 618307, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1262079413504623036, tenantId=1146029695717560320, journalId=1260987750510510108, articleId=1262079399604699418, authorId=1262079410849628586, language=CN, stringName=王在俊, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=2, address=2.中国民用航空飞行学院民航飞行技术与飞行安全工程技术重点实验室 广汉 618307, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1262079408786030964, tenantId=1146029695717560320, journalId=1260987750510510108, articleId=1262079399604699418, xref=2., ext=[AuthorCompanyExt(id=1262079408853139832, tenantId=1146029695717560320, journalId=1260987750510510108, articleId=1262079399604699418, companyId=1262079408786030964, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2.Key Laboratory of Flight Techniques and Flight Safety, Civil Aviation Flight University of China, Guanghan 618307, China), AuthorCompanyExt(id=1262079408895082876, tenantId=1146029695717560320, journalId=1260987750510510108, articleId=1262079399604699418, companyId=1262079408786030964, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2.中国民用航空飞行学院民航飞行技术与飞行安全工程技术重点实验室 广汉 618307)])]), Author(id=1262079415467557333, tenantId=1146029695717560320, journalId=1260987750510510108, articleId=1262079399604699418, orderNo=2, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=2951168474@qq.com, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1262079417648595428, tenantId=1146029695717560320, journalId=1260987750510510108, articleId=1262079399604699418, authorId=1262079415467557333, language=EN, stringName=Yuheng Jiang, firstName=Yuheng, middleName=null, lastName=Jiang, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=2, address=2.Key Laboratory of Flight Techniques and Flight Safety, Civil Aviation Flight University of China, Guanghan 618307, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1262079420211315185, tenantId=1146029695717560320, journalId=1260987750510510108, articleId=1262079399604699418, authorId=1262079415467557333, language=CN, stringName=蒋宇恒, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=2, address=2.中国民用航空飞行学院民航飞行技术与飞行安全工程技术重点实验室 广汉 618307, bio={"content":"

蒋宇恒,硕士,主要研究方向为生理信号处理及其在飞行安全领域的识别应用。E-mail:

"}, bioImg=null, bioContent=

蒋宇恒,硕士,主要研究方向为生理信号处理及其在飞行安全领域的识别应用。E-mail:

, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1262079408786030964, tenantId=1146029695717560320, journalId=1260987750510510108, articleId=1262079399604699418, xref=2., ext=[AuthorCompanyExt(id=1262079408853139832, tenantId=1146029695717560320, journalId=1260987750510510108, articleId=1262079399604699418, companyId=1262079408786030964, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2.Key Laboratory of Flight Techniques and Flight Safety, Civil Aviation Flight University of China, Guanghan 618307, China), AuthorCompanyExt(id=1262079408895082876, tenantId=1146029695717560320, journalId=1260987750510510108, articleId=1262079399604699418, companyId=1262079408786030964, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2.中国民用航空飞行学院民航飞行技术与飞行安全工程技术重点实验室 广汉 618307)])]), Author(id=1262079422614651389, tenantId=1146029695717560320, journalId=1260987750510510108, articleId=1262079399604699418, orderNo=3, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=764861685@qq.com, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1262079423164105221, tenantId=1146029695717560320, journalId=1260987750510510108, articleId=1262079399604699418, authorId=1262079422614651389, language=EN, stringName=Ruizhe Yang, firstName=Ruizhe, middleName=null, lastName=Yang, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=2, address=2.Key Laboratory of Flight Techniques and Flight Safety, Civil Aviation Flight University of China, Guanghan 618307, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1262079424414007831, tenantId=1146029695717560320, journalId=1260987750510510108, articleId=1262079399604699418, authorId=1262079422614651389, language=CN, stringName=杨睿哲, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=2, address=2.中国民用航空飞行学院民航飞行技术与飞行安全工程技术重点实验室 广汉 618307, bio={"content":"

杨睿哲,硕士,主要研究方向为生理信号处理及其在飞行安全领域的识别应用。E-mail:

"}, bioImg=null, bioContent=

杨睿哲,硕士,主要研究方向为生理信号处理及其在飞行安全领域的识别应用。E-mail:

, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1262079408786030964, tenantId=1146029695717560320, journalId=1260987750510510108, articleId=1262079399604699418, xref=2., ext=[AuthorCompanyExt(id=1262079408853139832, tenantId=1146029695717560320, journalId=1260987750510510108, articleId=1262079399604699418, companyId=1262079408786030964, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2.Key Laboratory of Flight Techniques and Flight Safety, Civil Aviation Flight University of China, Guanghan 618307, China), AuthorCompanyExt(id=1262079408895082876, tenantId=1146029695717560320, journalId=1260987750510510108, articleId=1262079399604699418, companyId=1262079408786030964, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2.中国民用航空飞行学院民航飞行技术与飞行安全工程技术重点实验室 广汉 618307)])])], keywords=[Keyword(id=1262079426062369310, tenantId=1146029695717560320, journalId=1260987750510510108, articleId=1262079399604699418, language=EN, orderNo=1, keyword=cognitive state recognition), Keyword(id=1262079427291300390, tenantId=1146029695717560320, journalId=1260987750510510108, articleId=1262079399604699418, language=EN, orderNo=2, keyword=flight safety), Keyword(id=1262079428042080812, tenantId=1146029695717560320, journalId=1260987750510510108, articleId=1262079399604699418, language=EN, orderNo=3, keyword=cross-modal attention), Keyword(id=1262079429312954935, tenantId=1146029695717560320, journalId=1260987750510510108, articleId=1262079399604699418, language=EN, orderNo=4, keyword=electroencephalography), Keyword(id=1262079431137477180, tenantId=1146029695717560320, journalId=1260987750510510108, articleId=1262079399604699418, language=EN, orderNo=5, keyword=deep learning), Keyword(id=1262079433494676039, tenantId=1146029695717560320, journalId=1260987750510510108, articleId=1262079399604699418, language=CN, orderNo=1, keyword=认知状态识别), Keyword(id=1262079435403084367, tenantId=1146029695717560320, journalId=1260987750510510108, articleId=1262079399604699418, language=CN, orderNo=2, keyword=飞行安全), Keyword(id=1262079435684102741, tenantId=1146029695717560320, journalId=1260987750510510108, articleId=1262079399604699418, language=CN, orderNo=3, keyword=跨模态注意力), Keyword(id=1262079436560712286, tenantId=1146029695717560320, journalId=1260987750510510108, articleId=1262079399604699418, language=CN, orderNo=4, keyword=脑电信号), Keyword(id=1262079440478192231, tenantId=1146029695717560320, journalId=1260987750510510108, articleId=1262079399604699418, language=CN, orderNo=5, keyword=深度学习)], refs=null, funds=[Fund(id=1262079441065394799, tenantId=1146029695717560320, journalId=1260987750510510108, articleId=1262079399604699418, awardId=FZ2022ZZ02, language=CN, fundingSource=民航飞行技术与飞行安全重点实验室自主研究项目(FZ2022ZZ02), fundOrder=null, country=null), Fund(id=1262079441522573940, tenantId=1146029695717560320, journalId=1260987750510510108, articleId=1262079399604699418, awardId=GY2024-64E, language=CN, fundingSource=四川省民航飞行技术与飞行安全工程技术研究中心项目(GY2024-64E), fundOrder=null, country=null)], companyList=[AuthorCompany(id=1262079407863284072, tenantId=1146029695717560320, journalId=1260987750510510108, articleId=1262079399604699418, xref=1., ext=[AuthorCompanyExt(id=1262079407880061289, tenantId=1146029695717560320, journalId=1260987750510510108, articleId=1262079399604699418, companyId=1262079407863284072, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1.College of Air Traffic Management, Civil Aviation Flight University of China, Guanghan 618307, China), AuthorCompanyExt(id=1262079408479846766, tenantId=1146029695717560320, journalId=1260987750510510108, articleId=1262079399604699418, companyId=1262079407863284072, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1.中国民用航空飞行学院空中交通管理学院 广汉 618307)]), AuthorCompany(id=1262079408786030964, tenantId=1146029695717560320, journalId=1260987750510510108, articleId=1262079399604699418, xref=2., ext=[AuthorCompanyExt(id=1262079408853139832, tenantId=1146029695717560320, journalId=1260987750510510108, articleId=1262079399604699418, companyId=1262079408786030964, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2.Key Laboratory of Flight Techniques and Flight Safety, Civil Aviation Flight University of China, Guanghan 618307, China), AuthorCompanyExt(id=1262079408895082876, tenantId=1146029695717560320, journalId=1260987750510510108, articleId=1262079399604699418, companyId=1262079408786030964, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2.中国民用航空飞行学院民航飞行技术与飞行安全工程技术重点实验室 广汉 618307)])], figs=null, attaches=null, journal=Journal(id=1260987432859090969, delFlag=0, nameCn=电子测量技术, nameEn=Electronic Measurement Technology, nameHistory1=null, nameHistory2=null, issn=1002-7300, eissn=null, cn=11-2175/TN, coden=null, periodic=3, language=CN, oaType=null, ccby=null, superviseOffice=null, ownerOffice=null, pubOffice=null, editorOffice=null, officeType=null, aims=null, clcCode=null, officeProv=null, officeCity=null, officeAddr=null, officeZip=null, officeEmail=null, officePhone=null, editDirector=null, officeDirector=null, officeDirectorPhone=null, officeStaffNum=null, officeEmpNum=null, coverPicUrl=pKFQJafOL5ABLx3QxMRT/g==, journalPrice=null, startedYear=null, abbrevIsoEn=Electronic Measurement Technology, journalRemark=null, publicationField=null, createdTime=1778572432012, updatedTime=1778572709318, createdBy=18614031015, updatedBy=13701087609, firstLetterCn=E, firstLetterEn=E, subjectCode=Engineering, subjectName=null, subjectCodeEn=Engineering, subjectNameEn=null, picCn=pKFQJafOL5ABLx3QxMRT/g==, picEn=VvWY+aS5ZQKZvXV5uqOm0Q==, jcr=null, cjcr=null, exts=[JournalExt(id=1260988596186694515, language=CN, name=电子测量技术, nameHistory1=null, nameHistory2=null, managedBy=, sponsoredBy=, publishedBy=, editorOffice=, officeProv=null, officeCity=null, officeAddr=, officeZip=, editDirector=, officeDirector=null, officePhone=null, coverPicUrl=null, journalRemark=, submitArticleUrl=null, websiteUrl=, createdTime=1778572709366, updatedTime=1778572709366, createdBy=13701087609, updatedBy=13701087609, submissionGuidelinesUrl=, submissionAuthorUrl=https://emt.etmchina.com/emt/author/login, submissionEditorUrl=https://emt.etmchina.com/emt/editor/login, submissionReviewUrl=https://emt.etmchina.com/emt/reviewer/login, submissionCeEditorUrl=, submissionAeEditorUrl=, option={"copyright":""}), JournalExt(id=1260988596245414772, language=EN, name=Electronic Measurement Technology, nameHistory1=null, nameHistory2=null, managedBy=, sponsoredBy=, publishedBy=, editorOffice=, officeProv=null, officeCity=null, officeAddr=, officeZip=, editDirector=, officeDirector=null, officePhone=null, coverPicUrl=null, journalRemark=, submitArticleUrl=null, websiteUrl=, createdTime=1778572709380, updatedTime=1778572709380, createdBy=13701087609, updatedBy=13701087609, submissionGuidelinesUrl=, submissionAuthorUrl=https://emt.etmchina.com/emt/author/login, submissionEditorUrl=https://emt.etmchina.com/emt/editor/login, submissionReviewUrl=https://emt.etmchina.com/emt/reviewer/login, submissionCeEditorUrl=, submissionAeEditorUrl=, option={"copyright":""})], databaseList=null, tenantJournalId=1260987750510510108, websiteList=[Website(id=1260990269097390900, webName=null, webTitle=null, webDomain=null, webCopyrigh=null, webIpcNo=null, seoTitle=null, seoKeywords=null, seoDescription=null, tenantJournalId=null, journalId=1260987750510510108, journalNameCn=null, journalNameEn=null, grayFlag=null, tenantId=1146029695717560320, platformId=null, journalGroupId=null, journalGroupNameCn=null, journalGroupNameEn=null, type=1, domain=https://castjournals.cast.org.cn/joweb/dzcljs/CN, language=CN, createTime=1778573108219, createBy=18614031015, updateTime=1778576584079, updateBy=18614031015, name=电子测量技术-中文, tplId=1146099689490845704, title=电子测量技术, delFlag=0, indexPage=/home, props=[WebsiteProps(id=1261004970938216792, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1260990269097390900, code=articleTextType, value=kx, createTime=1778576613411, updateTime=1778576613411, creator=18614031015, updator=18614031015), WebsiteProps(id=1261004970875302229, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1260990269097390900, code=banner, value=null, createTime=1778576613396, updateTime=1778576613396, creator=18614031015, updator=18614031015), WebsiteProps(id=1261004970959188315, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1260990269097390900, code=grayFlag, value=0, createTime=1778576613416, updateTime=1778576613416, creator=18614031015, updator=18614031015), WebsiteProps(id=1261004970866913620, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1260990269097390900, code=logo, value=https://castjournals.cast.org.cn/joweb/dzcljs/CN/file/pic?fileId=sKVVjY9hwKgYWVksbpAtUw==, createTime=1778576613394, updateTime=1778576613394, creator=18614031015, updator=18614031015), WebsiteProps(id=1261004970975965533, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1260990269097390900, code=minRunFlag, value=0, createTime=1778576613420, updateTime=1778576613420, creator=18614031015, updator=18614031015), WebsiteProps(id=1261004970892079447, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1260990269097390900, code=picServerUrl, value=https://castjournals.cast.org.cn/joweb/dzcljs/CN/file/pic, createTime=1778576613400, updateTime=1778576613400, creator=18614031015, updator=18614031015), WebsiteProps(id=1261004970967576924, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1260990269097390900, code=silenceFlag, value=0, createTime=1778576613418, updateTime=1778576613418, creator=18614031015, updator=18614031015), WebsiteProps(id=1261004970883690838, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1260990269097390900, code=staticResourcePath, value=https://castjournals.cast.org.cn/joweb/cast_kjdb_cn_619/, createTime=1778576613398, updateTime=1778576613398, creator=18614031015, updator=18614031015), WebsiteProps(id=1261004970946605401, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1260990269097390900, code=themeColor, value=null, createTime=1778576613413, updateTime=1778576613413, creator=18614031015, updator=18614031015), WebsiteProps(id=1261004970950799706, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1260990269097390900, code=themeStyle, value=null, createTime=1778576613414, updateTime=1778576613414, creator=18614031015, updator=18614031015)]), Website(id=1260990269269357367, webName=null, webTitle=null, webDomain=null, webCopyrigh=null, webIpcNo=null, seoTitle=null, seoKeywords=null, seoDescription=null, tenantJournalId=null, journalId=1260987750510510108, journalNameCn=null, journalNameEn=null, grayFlag=null, tenantId=1146029695717560320, platformId=null, journalGroupId=null, journalGroupNameCn=null, journalGroupNameEn=null, type=1, domain=https://castjournals.cast.org.cn/joweb/dzcljs/EN, language=EN, createTime=1778573108260, createBy=18614031015, updateTime=1778576580634, updateBy=18614031015, name=电子测量技术-英文, tplId=1146101810881728533, title=Electronic Measurement Technology, delFlag=0, indexPage=/home, props=[WebsiteProps(id=1261004931830526286, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1260990269269357367, code=articleTextType, value=kx, createTime=1778576604087, updateTime=1778576604087, creator=18614031015, updator=18614031015), WebsiteProps(id=1261004931809554763, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1260990269269357367, code=banner, value=null, createTime=1778576604082, updateTime=1778576604082, creator=18614031015, updator=18614031015), WebsiteProps(id=1261004931855692113, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1260990269269357367, code=grayFlag, value=0, createTime=1778576604093, updateTime=1778576604093, creator=18614031015, updator=18614031015), WebsiteProps(id=1261004931801166154, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1260990269269357367, code=logo, value=https://castjournals.cast.org.cn/joweb/dzcljs/EN/file/pic?fileId=sKVVjY9hwKgYWVksbpAtUw==, createTime=1778576604080, updateTime=1778576604080, creator=18614031015, updator=18614031015), WebsiteProps(id=1261004931893440851, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1260990269269357367, code=minRunFlag, value=0, createTime=1778576604102, updateTime=1778576604102, creator=18614031015, updator=18614031015), WebsiteProps(id=1261004931822137677, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1260990269269357367, code=picServerUrl, value=https://castjournals.cast.org.cn/joweb/dzcljs/EN/file/pic, createTime=1778576604085, updateTime=1778576604085, creator=18614031015, updator=18614031015), WebsiteProps(id=1261004931885052242, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1260990269269357367, code=silenceFlag, value=0, createTime=1778576604100, updateTime=1778576604100, creator=18614031015, updator=18614031015), WebsiteProps(id=1261004931813749068, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1260990269269357367, code=staticResourcePath, value=https://castjournals.cast.org.cn/joweb/cast_kjdb_en_623/, createTime=1778576604083, updateTime=1778576604083, creator=18614031015, updator=18614031015), WebsiteProps(id=1261004931838914895, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1260990269269357367, code=themeColor, value=null, createTime=1778576604089, updateTime=1778576604089, creator=18614031015, updator=18614031015), WebsiteProps(id=1261004931847303504, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1260990269269357367, code=themeStyle, value=null, createTime=1778576604091, updateTime=1778576604091, creator=18614031015, updator=18614031015)])], journalTitle=电子测量技术, weixinUrl=null, journalUrl=null, iacademicId=null, status=1, seqNo=null, journalTitleEn=Electronic Measurement Technology, journalPhotoCn=pKFQJafOL5ABLx3QxMRT/g==, journalPhotoEn=VvWY+aS5ZQKZvXV5uqOm0Q==, journalFirstLetter=E, journalRecommend=null, journalNew=null, journalCollection=null, jcrJf=null, cjcrJf=null, jcrJfStr=null, cjcrJfStr=null, submissionFirstDecision=null, sciSubjectClassification=null, casSubjectClassification=null, citeScore=null, totalCitationFrequency=null, icpCode=null, psCode=null, advertisingLicenseCode=null, copyrightInformation=null, country=null, option=, provinceCode=null, provinceName=null, collectFlag=false), detailUrlCn=https://castjournals.cast.org.cn/joweb/dzcljs/CN/10.19651/j.cnki.emt.2519375, detailUrlEn=https://castjournals.cast.org.cn/joweb/dzcljs/EN/10.19651/j.cnki.emt.2519375, pdfUrlCn=https://castjournals.cast.org.cn/joweb/dzcljs/CN/PDF/10.19651/j.cnki.emt.2519375, pdfUrlEn=https://castjournals.cast.org.cn/joweb/dzcljs/EN/PDF/10.19651/j.cnki.emt.2519375, aliStartDate=null, aliEndDate=null, collectionFlag=false, citedCount=null, citedUrl=null, reference=null)
收藏切换
基于跨模态生理信号融合的飞行员认知状态检测
收藏切换
PDF下载
张文泽 1 , 王在俊 2 , 蒋宇恒 2 , 杨睿哲 2
电子测量技术 | 数据采集及信号处理 2026,49(6): 146-155
收起
收藏切换
电子测量技术 | 数据采集及信号处理 2026, 49(6): 146-155
基于跨模态生理信号融合的飞行员认知状态检测
全屏
张文泽1 , 王在俊2 , 蒋宇恒2 , 杨睿哲2
作者信息
  • 1.中国民用航空飞行学院空中交通管理学院 广汉 618307
  • 2.中国民用航空飞行学院民航飞行技术与飞行安全工程技术重点实验室 广汉 618307
  • 张文泽,硕士,主要研究方向为生理信号处理及其在飞行安全领域的识别应用。E-mail:

    蒋宇恒,硕士,主要研究方向为生理信号处理及其在飞行安全领域的识别应用。E-mail:

    杨睿哲,硕士,主要研究方向为生理信号处理及其在飞行安全领域的识别应用。E-mail:

通讯作者:

王在俊(通信作者),研究员,硕士生导师,主要研究方向为飞行技术与飞行安全、智能计算。E-mail:
Detection of pilots' cognitive states based on cross-modal physiological signal fusion
Wenze Zhang1 , Zaijun Wang2 , Yuheng Jiang2 , Ruizhe Yang2
Affiliations
  • 1.College of Air Traffic Management, Civil Aviation Flight University of China, Guanghan 618307, China
  • 2.Key Laboratory of Flight Techniques and Flight Safety, Civil Aviation Flight University of China, Guanghan 618307, China
doi: 10.19651/j.cnki.emt.2519375
文章导航
收藏切换

飞行员认知状态的精准评估对保障飞行安全至关重要,然而现有方法在多模态生理信号融合上存在局限性。为此,本文提出一种基于双向跨模态注意力的双流深度学习网络。该模型采用并行双分支架构:脑电(EEG)分支通过相位锁定值(PLV)量化大脑功能连接,并采用SE模块增强的密集连接网络进行深度特征提取;心电(ECG)分支则提取心率变异性(HRV)及波形特征,经残差连接多层感知机处理以表征自主神经系统活动。在此基础上,通过创新设计的双向跨模态注意力模块,动态加权融合双路深度特征,实现对注意力集中、分散和惊吓/惊奇3种状态的精准分类。在NASA公开数据集上的实验表明,模型总体识别准确率达97.44%。消融与对比分析证实,该融合策略显著优于单模态分析和简单的特征拼接方法。研究表明,通过注意力机制深度融合EEG功能连接与ECG生理信息,可有效提升认知状态识别性能,该方法为开发客观、高效的飞行员状态监测系统提供了可靠的技术支持,对提升飞行安全具有重要的应用价值。

认知状态识别  /  飞行安全  /  跨模态注意力  /  脑电信号  /  深度学习

Accurate assessment of pilot cognitive states is critical for ensuring flight safety, yet existing methods exhibit limitations in fusing multimodal physiological signals. To address this, this paper proposes a dual-stream deep learning network based on bidirectional cross-modal attention. The model adopts a parallel dual-branch architecture: The electroencephalography (EEG) branch quantifies brain functional connectivity through phase locking value (PLV) features and employs a densely connected network enhanced with squeeze-and-excitation (SE) modules for deep feature extraction; the electrocardiogram (ECG) branch extracts heart rate variability (HRV) and waveform features, processed by a residual-connected multilayer perceptron to characterize autonomic nervous system activity. Building upon this, an innovatively designed bidirectional cross-modal attention module dynamically weights and fuses the dual-path deep features to achieve precise classification of three states—concentrated attention, distracted attention, and startle/surprise. Experimental results on the NASA public dataset demonstrate an overall recognition accuracy of 97.44%. Ablation and comparative analyses confirm that the fusion strategy significantly outperforms single-modality analysis and simple feature concatenation methods. The study reveals that deep integration of EEG functional connectivity and ECG physiological information via attention mechanisms effectively enhances cognitive state recognition performance. This approach provides reliable technical support for developing objective and efficient pilot state monitoring systems, holding significant application value for improving flight safety.

cognitive state recognition  /  flight safety  /  cross-modal attention  /  electroencephalography  /  deep learning
张文泽, 王在俊, 蒋宇恒, 杨睿哲. 基于跨模态生理信号融合的飞行员认知状态检测. 电子测量技术, 2026 , 49 (6) : 146 -155 . DOI: 10.19651/j.cnki.emt.2519375
Wenze Zhang, Zaijun Wang, Yuheng Jiang, Ruizhe Yang. Detection of pilots' cognitive states based on cross-modal physiological signal fusion[J]. Electronic Measurement Technology, 2026 , 49 (6) : 146 -155 . DOI: 10.19651/j.cnki.emt.2519375
  • 民航飞行技术与飞行安全重点实验室自主研究项目(FZ2022ZZ02)
  • 四川省民航飞行技术与飞行安全工程技术研究中心项目(GY2024-64E)
2026年第49卷第6期
PDF下载
24
5
引用本文
BibTeX
文章信息
doi: 10.19651/j.cnki.emt.2519375
  • 接收时间:2025-07-16
  • 首发时间:2026-05-15
补充材料
相关文章
文章信息
作者
出版历史
  • 收稿日期:2025-07-16
基金
民航飞行技术与飞行安全重点实验室自主研究项目(FZ2022ZZ02)
四川省民航飞行技术与飞行安全工程技术研究中心项目(GY2024-64E)
作者信息
    1.中国民用航空飞行学院空中交通管理学院 广汉 618307
    2.中国民用航空飞行学院民航飞行技术与飞行安全工程技术重点实验室 广汉 618307

通讯作者:

王在俊(通信作者),研究员,硕士生导师,主要研究方向为飞行技术与飞行安全、智能计算。E-mail:
参考文献
分享链接
https://castjournals.cast.org.cn/joweb/dzcljs/CN/10.19651/j.cnki.emt.2519375
分享至
全文二维码

扫描看全文

引用本文
BibTeX
本文的引用情况
2种不同金属材料的力学参数

Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)

Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏