Article(id=1282030049167655358, tenantId=1146029695717560320, journalId=1146031787341344770, issueId=1282030021623657005, articleNumber=null, orderNo=null, doi=10.16265/j.cnki.issn1003-3033.2025.08.0084, pmid=null, cstr=null, oa=null, hot=null, price=null, onlineType=0, articleFormat=0, articleType=null, articleTypeStr=null, receivedDate=1740758400000, receivedDateStr=2025-03-01, revisedDate=1747065600000, revisedDateStr=2025-05-13, acceptedDate=null, acceptedDateStr=null, onlineDate=1783589382687, onlineDateStr=2026-07-09, pubDate=1756310400000, pubDateStr=2025-08-28, doiRegisterDate=null, doiRegisterDateStr=null, onlineIssueDate=1783589382687, onlineIssueDateStr=2026-07-09, onlineJustAcceptDate=null, onlineJustAcceptDateStr=null, onlineFirstDate=null, onlineFirstDateStr=null, sourceXml=null, magXml=null, createTime=1783589382687, creator=13701087609, updateTime=1783589382687, updator=13701087609, issue=Issue{id=1282030021623657005, tenantId=1146029695717560320, journalId=1146031787341344770, year='2025', volume='35', issue='8', pageStart='1', pageEnd='276', issueExtLink='null', onlineDate='null', pubDate='1756310400000', pubDateStr='2025-08-28', beforeIssueId=null, nextIssueId=null, price=null, status=1, issueComplete=1, articleOrder=1, issueType=-1, specialIssue=null, createTime=1783589376121, creator='13701087609', updateTime=1783589731222, updator='13701087609', preIssue=null, nextIssue=null, articleTotal=null, ext={EN=IssueExt(id=1282031511155228698, tenantId=1146029695717560320, journalId=1146031787341344770, issueId=1282030021623657005, language=EN, specialIssueTitle=, coverIllustrator=null, specialIssueEditor=, specialIssueAbout=), CN=IssueExt(id=1282031511155228699, tenantId=1146029695717560320, journalId=1146031787341344770, issueId=1282030021623657005, language=CN, specialIssueTitle=, coverIllustrator=null, specialIssueEditor=, specialIssueAbout=)}, issueFiles=null, downloadFileDto=null}, startPage=84, endPage=92, ext={EN=ArticleExt(id=1282030049423507903, articleId=1282030049167655358, tenantId=1146029695717560320, journalId=1146031787341344770, language=EN, title=Multimodal information fusion decision-making strategy for personnel behavior in industrial scene, columnId=1149733269173878863, journalTitle=China Safety Science Journal, columnName=Safety engineering technology, runingTitle=null, highlight=null, articleAbstract=

In order to reduce the accidents in industrial scenarios which were caused by workers'unsafe operation behaviors, meanwhile improve the performance of visual-based action recognition methods in industrial scene with poor lighting, limited field of view and occlusions, an improved decision-making strategy based on self-adaptive ER (S-ER) was introduced in this paper. This strategy could integrate video information and inertial measurement unit (IMU) information effectively. It firstly analyzed video information and IMU information with attention mechanism-based multi-task convolutional 3D (M-C3D) model as well as one-dimensional convolutional neural network (1D-CNN) fused with attention mechanism, then ER theory was introduced to achieve decision-level fusion, where the set of evidence weights and reliability under different environmental conditions was optimized through the firefly optimization algorithm for improving the recognition accuracy and robustness of the model. The effectiveness of the proposed algorithm was verified on the public dataset Multimodal Human Action Dataset from University of Texas at Dallas(UTD-MHAD) and the self-built dataset Multimodal Human Action Dataset from Zhongyuan University of Technology(ZUT-MHAD). The results show that the identification results of S-ER for workers'unsafe behaviors in complex industrial scenarios can reach up to 98.53%, which is 17.52% higher than the maximum value of traditional multimodal fusion methods and single-modality recognition methods.

, authors=Haiquan WANG1, Haowei YU2, Yueyi YANG1, Xiaobin XU3, Xiangzhou BU4, P KURKOVA5, authorsList=Haiquan WANG, Haowei YU, Yueyi YANG, Xiaobin XU, Xiangzhou BU, P KURKOVA, authorCompany=null, correspAuthors=null, authorNote=null, correspAuthorsNote=null, copyrightStatement=null, copyrightOwner=null, extLink=null, articleAbsUrl=null, sourceXml=null, magXml=null, pdfUrl=null, pdf=null, pdfFileSize=null, pdfExtLink=null, richHtmlUrl=null, mobilePdfUrl=null, reviewReport=null, pdfFirstPage=null, abstractGraph=null, abstractGraphContent=null, abstractVideo=null, citation=null, cebUrl=null, magXmlContent=null, mapNumber=null, fund=null), CN=ArticleExt(id=1282030049935212994, articleId=1282030049167655358, tenantId=1146029695717560320, journalId=1146031787341344770, language=CN, title=工业场景下人员行为的多模态信息融合决策策略, columnId=1149733269727526997, journalTitle=中国安全科学学报, columnName=安全工程技术, runingTitle=null, highlight=null, articleAbstract=

为预防工业场景下人员不安全生产行为所导致的安全事故,解决光线不佳、视野受限和遮挡等干扰情况下单一视觉模态动作识别效果不佳的问题,提出一种基于自适应证据推理(S-ER)策略,融合视频信息和惯性测量元件(IMU)信息的人员不安全行为决策方法。首先,构建基于注意力机制的多任务三维卷积模型(M-C3D),分析视频信息,运用融合注意力机制的一维卷积神经网络(1D-CNN)处理IMU信息;其次,运用证据推理(ER)策略实现决策级融合,并通过萤火虫优化算法构建不同环境条件下证据权重和可靠度的优化集合,确保视频和传感器模态信息的权重能够根据环境情况自适应调整;最后,通过德克萨斯大学达拉斯分校的多模态人员行为数据集(UTD-MHAD)和中原工学院的多模态人员行为数据集(ZUT-MHAD)验证模型的有效性。结果表明:在存在干扰的工业场景中,S-ER方法的识别准确率最高可达98.53%,较传统多模态融合方法及单模态识别方法的最高值提升17.52%。

, authors=王海泉教授1, 于浩玮2, 杨岳毅讲师1, 徐晓滨教授3, 卜祥洲高级工程师4, KURKOVAP5, authorsList=王海泉教授, 于浩玮, 杨岳毅讲师, 徐晓滨教授, 卜祥洲高级工程师, KURKOVAP, authorCompany=null, correspAuthors=null, authorNote=

王海泉(1981—),男,河南郑州人,博士,教授,硕士生导师,主要从事多模态数据挖掘技术、故障诊断等方面的研究。E-mail:

, correspAuthorsNote=null, copyrightStatement=null, copyrightOwner=null, extLink=null, articleAbsUrl=null, sourceXml=Ioa0ssFjgYw/dxFdeojo4g==, magXml=cukgn7przat3o1UApH4w8g==, pdfUrl=null, pdf=o+dwq+HAXicYY9DihkSuPg==, pdfFileSize=2103581, pdfExtLink=null, richHtmlUrl=null, mobilePdfUrl=null, reviewReport=null, pdfFirstPage=null, abstractGraph=null, abstractGraphContent=null, abstractVideo=null, citation=null, cebUrl=null, magXmlContent=+yJk3Dp82/wW6/EyMFjE+Q==, mapNumber=null, fund=null)}, authors=[Author(id=1282030050665021907, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, orderNo=0, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=wanghq@zut.edu.cn, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1282030050782462421, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, authorId=1282030050665021907, language=EN, stringName=Haiquan WANG, firstName=Haiquan, middleName=null, lastName=WANG, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, address=1College of Intelligent Sensing and Instrumentation, Zhongyuan University of Technology, Zhengzhou Henan 450007, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1282030050857959895, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, authorId=1282030050665021907, language=CN, stringName=王海泉教授, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, address=1中原工学院 智能感知与仪器学院,河南 郑州 450007, bio={"content":"

王海泉(1981—),男,河南郑州人,博士,教授,硕士生导师,主要从事多模态数据挖掘技术、故障诊断等方面的研究。E-mail:

"}, bioImg=null, bioContent=

王海泉(1981—),男,河南郑州人,博士,教授,硕士生导师,主要从事多模态数据挖掘技术、故障诊断等方面的研究。E-mail:

, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1282030050178482627, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, xref=1, ext=[AuthorCompanyExt(id=1282030050186871236, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, companyId=1282030050178482627, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1College of Intelligent Sensing and Instrumentation, Zhongyuan University of Technology, Zhengzhou Henan 450007, China), AuthorCompanyExt(id=1282030050199454149, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, companyId=1282030050178482627, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1中原工学院 智能感知与仪器学院,河南 郑州 450007)])]), Author(id=1282030050941845977, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, orderNo=1, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1282030051050897883, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, authorId=1282030050941845977, language=EN, stringName=Haowei YU, firstName=Haowei, middleName=null, lastName=YU, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=2, address=2School of Automation and Electrical Engineering, Zhongyuan University of Technology, Zhengzhou Henan 450007, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1282030051130589660, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, authorId=1282030050941845977, language=CN, stringName=于浩玮, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=2, address=2中原工学院 自动化与电气工程学院,河南 郑州 450007, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1282030050291728838, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, xref=2, ext=[AuthorCompanyExt(id=1282030050308506055, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, companyId=1282030050291728838, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2School of Automation and Electrical Engineering, Zhongyuan University of Technology, Zhengzhou Henan 450007, China), AuthorCompanyExt(id=1282030050321088968, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, companyId=1282030050291728838, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2中原工学院 自动化与电气工程学院,河南 郑州 450007)])]), Author(id=1282030051252224478, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, orderNo=2, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1282030051319333344, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, authorId=1282030051252224478, language=EN, stringName=Yueyi YANG, firstName=Yueyi, middleName=null, lastName=YANG, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, address=1College of Intelligent Sensing and Instrumentation, Zhongyuan University of Technology, Zhengzhou Henan 450007, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1282030051390636513, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, authorId=1282030051252224478, language=CN, stringName=杨岳毅讲师, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, address=1中原工学院 智能感知与仪器学院,河南 郑州 450007, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1282030050178482627, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, xref=1, ext=[AuthorCompanyExt(id=1282030050186871236, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, companyId=1282030050178482627, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1College of Intelligent Sensing and Instrumentation, Zhongyuan University of Technology, Zhengzhou Henan 450007, China), AuthorCompanyExt(id=1282030050199454149, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, companyId=1282030050178482627, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1中原工学院 智能感知与仪器学院,河南 郑州 450007)])]), Author(id=1282030053047386595, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, orderNo=3, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1282030053127078373, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, authorId=1282030053047386595, language=EN, stringName=Xiaobin XU, firstName=Xiaobin, middleName=null, lastName=XU, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=3, address=3College of Automation, Hangzhou Dianzi University, Hangzhou Zhejiang 310018, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1282030053215158758, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, authorId=1282030053047386595, language=CN, stringName=徐晓滨教授, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=3, address=3杭州电子科技大学 自动化学院,浙江 杭州 310018, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1282030050388197833, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, xref=3, ext=[AuthorCompanyExt(id=1282030050392392138, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, companyId=1282030050388197833, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=3College of Automation, Hangzhou Dianzi University, Hangzhou Zhejiang 310018, China), AuthorCompanyExt(id=1282030050400780747, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, companyId=1282030050388197833, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=3杭州电子科技大学 自动化学院,浙江 杭州 310018)])]), Author(id=1282030053299044840, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, orderNo=4, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1282030053374542314, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, authorId=1282030053299044840, language=EN, stringName=Xiangzhou BU, firstName=Xiangzhou, middleName=null, lastName=BU, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=4, address=4Henan Hongbo Measurment and Control Co., Ltd., Zhengzhou Henan 450040, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1282030053512954347, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, authorId=1282030053299044840, language=CN, stringName=卜祥洲高级工程师, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=4, address=4河南宏博测控技术有限公司,河南 郑州 450040, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1282030050463695308, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, xref=4, ext=[AuthorCompanyExt(id=1282030050476278221, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, companyId=1282030050463695308, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=4Henan Hongbo Measurment and Control Co., Ltd., Zhengzhou Henan 450040, China), AuthorCompanyExt(id=1282030050480472526, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, companyId=1282030050463695308, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=4河南宏博测控技术有限公司,河南 郑州 450040)])]), Author(id=1282030053617811949, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, orderNo=5, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1282030053697503727, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, authorId=1282030053617811949, language=EN, stringName=P KURKOVA, firstName=P, middleName=null, lastName=KURKOVA, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=5, address=5School of Electronic and Laser Instrument, Saint Petersburg State University of Aerospace Instrumentation, Saint Petersburg 14-51, Russia, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1282030053773001200, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, authorId=1282030053617811949, language=CN, stringName=KURKOVAP, firstName=P, middleName=null, lastName=KURKOVA, prefix=null, suffix=教授, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=5, address=5圣彼得堡国立宇航与仪器制造大学 电子与激光仪器系,俄罗斯 圣彼得堡 14-51, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1282030050560164303, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, xref=5, ext=[AuthorCompanyExt(id=1282030050568552912, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, companyId=1282030050560164303, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=5School of Electronic and Laser Instrument, Saint Petersburg State University of Aerospace Instrumentation, Saint Petersburg 14-51, Russia), AuthorCompanyExt(id=1282030050589524433, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, companyId=1282030050560164303, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=5圣彼得堡国立宇航与仪器制造大学 电子与激光仪器系,俄罗斯 圣彼得堡 14-51)])])], keywords=[Keyword(id=1282030053873664497, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, language=EN, orderNo=1, keyword=industrial scene), Keyword(id=1282030053957550578, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, language=EN, orderNo=2, keyword=multimodal information), Keyword(id=1282030054045630963, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, language=EN, orderNo=3, keyword=information fusion), Keyword(id=1282030054104351220, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, language=EN, orderNo=4, keyword=action recognition), Keyword(id=1282030054175654389, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, language=EN, orderNo=5, keyword=evidence reasoning (ER) theory), Keyword(id=1282030054263734774, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, language=CN, orderNo=1, keyword=工业场景), Keyword(id=1282030054351815159, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, language=CN, orderNo=2, keyword=多模态信息), Keyword(id=1282030054418924024, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, language=CN, orderNo=3, keyword=信息融合), Keyword(id=1282030054490227193, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, language=CN, orderNo=4, keyword=行为识别), Keyword(id=1282030054553141754, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, language=CN, orderNo=5, keyword=证据推理(ER)策略)], refs=null, funds=[Fund(id=1282030054657999355, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, awardId=251111211600, language=CN, fundingSource=河南重点研发专项项目(251111211600), fundOrder=null, country=null), Fund(id=1282030054767051260, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, awardId=242102320215, language=CN, fundingSource=河南省科技攻关项目(242102320215), fundOrder=null, country=null), Fund(id=1282030054855131645, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, awardId=HNGD2024032, language=CN, fundingSource=河南省高端外国专家引进计划项目(HNGD2024032), fundOrder=null, country=null), Fund(id=1282030054926434814, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, awardId=GG202412, language=CN, fundingSource=中原工学院学科实力提升计划项目(GG202412), fundOrder=null, country=null)], companyList=[AuthorCompany(id=1282030050178482627, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, xref=1, ext=[AuthorCompanyExt(id=1282030050186871236, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, companyId=1282030050178482627, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1College of Intelligent Sensing and Instrumentation, Zhongyuan University of Technology, Zhengzhou Henan 450007, China), AuthorCompanyExt(id=1282030050199454149, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, companyId=1282030050178482627, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1中原工学院 智能感知与仪器学院,河南 郑州 450007)]), AuthorCompany(id=1282030050291728838, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, xref=2, ext=[AuthorCompanyExt(id=1282030050308506055, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, companyId=1282030050291728838, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2School of Automation and Electrical Engineering, Zhongyuan University of Technology, Zhengzhou Henan 450007, China), AuthorCompanyExt(id=1282030050321088968, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, companyId=1282030050291728838, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2中原工学院 自动化与电气工程学院,河南 郑州 450007)]), AuthorCompany(id=1282030050388197833, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, xref=3, ext=[AuthorCompanyExt(id=1282030050392392138, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, companyId=1282030050388197833, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=3College of Automation, Hangzhou Dianzi University, Hangzhou Zhejiang 310018, China), AuthorCompanyExt(id=1282030050400780747, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, companyId=1282030050388197833, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=3杭州电子科技大学 自动化学院,浙江 杭州 310018)]), AuthorCompany(id=1282030050463695308, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, xref=4, ext=[AuthorCompanyExt(id=1282030050476278221, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, companyId=1282030050463695308, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=4Henan Hongbo Measurment and Control Co., Ltd., Zhengzhou Henan 450040, China), AuthorCompanyExt(id=1282030050480472526, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, companyId=1282030050463695308, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=4河南宏博测控技术有限公司,河南 郑州 450040)]), AuthorCompany(id=1282030050560164303, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, xref=5, ext=[AuthorCompanyExt(id=1282030050568552912, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, companyId=1282030050560164303, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=5School of Electronic and Laser Instrument, Saint Petersburg State University of Aerospace Instrumentation, Saint Petersburg 14-51, Russia), AuthorCompanyExt(id=1282030050589524433, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, companyId=1282030050560164303, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=5圣彼得堡国立宇航与仪器制造大学 电子与激光仪器系,俄罗斯 圣彼得堡 14-51)])], figs=null, attaches=null, journal=Journal(id=1123942128916217864, delFlag=0, nameCn=中国安全科学学报, nameEn=China Safety Science Journal, nameHistory1=null, nameHistory2=null, issn=1003-3033, eissn=, cn=11-2865/X, coden=null, periodic=0, language=CN, oaType=0, ccby=null, superviseOffice=null, ownerOffice=null, pubOffice=null, editorOffice=null, officeType=null, aims=null, clcCode=null, officeProv=null, officeCity=null, officeAddr=null, officeZip=null, officeEmail=null, officePhone=null, editDirector=null, officeDirector=null, officeDirectorPhone=null, officeStaffNum=null, officeEmpNum=null, coverPicUrl=fkqsFM6VKlHC4gCtS5XqTw==, journalPrice=null, startedYear=null, abbrevIsoEn=Chin Saf Sci J, journalRemark=null, publicationField=null, createdTime=null, updatedTime=1784015834644, createdBy=null, updatedBy=13041195026, firstLetterCn=Z, firstLetterEn=Z, subjectCode=Engineering, subjectName=工程, subjectCodeEn=Engineering, subjectNameEn=null, picCn=fkqsFM6VKlHC4gCtS5XqTw==, picEn=SHn9HgqSxtJrOcAxqD++4Q==, jcr=null, cjcr=null, exts=[JournalExt(id=1283818719495308010, language=CN, name=中国安全科学学报, nameHistory1=null, nameHistory2=null, managedBy=中国科学技术协会, sponsoredBy=中国职业安全健康协会, publishedBy=《中国安全科学学报》编辑部, editorOffice=, officeProv=null, officeCity=null, officeAddr=, officeZip=, editDirector=, officeDirector=null, officePhone=null, coverPicUrl=null, journalRemark=, submitArticleUrl=null, websiteUrl=http://www.cssjj.com.cn/, createdTime=1784015834926, updatedTime=1784015834926, createdBy=13041195026, updatedBy=13041195026, submissionGuidelinesUrl=http://www.cssjj.com.cn/CN/column/item15.shtml, submissionAuthorUrl=https://zgaqkxxbauthor.manuscriptcloud.com/login, submissionEditorUrl=https://zgaqkxxbeditor.manuscriptcloud.com/login, submissionReviewUrl=https://zgaqkxxbauthor.manuscriptcloud.com/login, submissionCeEditorUrl=https://zgaqkxxbeditor.manuscriptcloud.com/login, submissionAeEditorUrl=https://zgaqkxxbeditor.manuscriptcloud.com/login, option={"copyright":""}), JournalExt(id=1283818719541445355, language=EN, name=China Safety Science Journal, nameHistory1=null, nameHistory2=null, managedBy=, sponsoredBy=, publishedBy=, editorOffice=, officeProv=null, officeCity=null, officeAddr=, officeZip=, editDirector=, officeDirector=null, officePhone=null, coverPicUrl=null, journalRemark=, submitArticleUrl=null, websiteUrl=http://www.cssjj.com.cn/EN/1003-3033/home.shtml, createdTime=1784015834937, updatedTime=1784015834937, createdBy=13041195026, updatedBy=13041195026, submissionGuidelinesUrl=https://synbioj.cip.com.cn/EN/column/column3.shtml, submissionAuthorUrl=https://zgaqkxxbauthor.manuscriptcloud.com/login, submissionEditorUrl=https://zgaqkxxbeditor.manuscriptcloud.com/login, submissionReviewUrl=https://zgaqkxxbauthor.manuscriptcloud.com/login, submissionCeEditorUrl=https://zgaqkxxbeditor.manuscriptcloud.com/login, submissionAeEditorUrl=https://zgaqkxxbeditor.manuscriptcloud.com/login, option={"copyright":""})], databaseList=null, tenantJournalId=1146031787341344770, websiteList=[Website(id=1148243202345263519, webName=null, webTitle=null, webDomain=null, webCopyrigh=null, webIpcNo=null, seoTitle=null, seoKeywords=null, seoDescription=null, tenantJournalId=null, journalId=1146031787341344770, journalNameCn=null, journalNameEn=null, grayFlag=null, tenantId=1146029695717560320, platformId=null, journalGroupId=null, journalGroupNameCn=null, journalGroupNameEn=null, type=1, domain=https://castjournals.cast.org.cn/joweb/zgaqkxxb/CN, language=CN, createTime=1751692112766, createBy=18614031015, updateTime=1753502583634, updateBy=18614031015, name=《中国安全科学学报》中文站点, tplId=1146099689490845704, title=中国安全科学学报, delFlag=0, indexPage=/home, props=[WebsiteProps(id=1148618794941046792, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1148243202345263519, code=articleTextType, value=kx, createTime=1751781661020, updateTime=1751781661020, creator=18614031015, updator=18614031015), WebsiteProps(id=1148618794911686661, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1148243202345263519, code=banner, value=null, createTime=1751781661012, updateTime=1751781661012, creator=18614031015, updator=18614031015), WebsiteProps(id=1148618794894909444, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1148243202345263519, code=logo, value=https://castjournals.cast.org.cn/joweb/kjdb/CN/file/pic?fileId=tui0IVO9FMwB61HHtX5scg==, createTime=1751781661008, updateTime=1751781661008, creator=18614031015, updator=18614031015), WebsiteProps(id=1148618794932658183, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1148243202345263519, code=picServerUrl, value=https://castjournals.cast.org.cn/joweb/kjdb/CN/file/pic, createTime=1751781661017, updateTime=1751781661017, creator=18614031015, updator=18614031015), WebsiteProps(id=1148618794924269574, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1148243202345263519, code=staticResourcePath, value=https://castjournals.cast.org.cn/joweb/cast_kjdb_cn_619/, createTime=1751781661015, updateTime=1751781661015, creator=18614031015, updator=18614031015)]), Website(id=1155836763751993353, webName=null, webTitle=null, webDomain=null, webCopyrigh=null, webIpcNo=null, seoTitle=null, seoKeywords=null, seoDescription=null, tenantJournalId=null, journalId=1146031787341344770, journalNameCn=null, journalNameEn=null, grayFlag=null, tenantId=1146029695717560320, platformId=null, journalGroupId=null, journalGroupNameCn=null, journalGroupNameEn=null, type=1, domain=https://castjournals.cast.org.cn/joweb/zgaqkxxb/EN, language=EN, createTime=1753502558893, createBy=18614031015, updateTime=1753524450387, updateBy=18614031015, name=《中国安全科学学报》英文站点, tplId=1146101810881728533, title=China Safety Science Journal, delFlag=0, indexPage=/home, props=[WebsiteProps(id=1155895925743669425, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1155836763751993353, code=articleTextType, value=kx, createTime=1753516664205, updateTime=1753516664205, creator=18614031015, updator=18614031015), WebsiteProps(id=1155895925722697902, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1155836763751993353, code=banner, value=null, createTime=1753516664200, updateTime=1753516664200, creator=18614031015, updator=18614031015), WebsiteProps(id=1155895925714309293, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1155836763751993353, code=logo, value=https://castjournals.cast.org.cn/joweb/kjdb/CN/file/pic?fileId=tui0IVO9FMwB61HHtX5scg==, createTime=1753516664198, updateTime=1753516664198, creator=18614031015, updator=18614031015), WebsiteProps(id=1155895925735280816, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1155836763751993353, code=picServerUrl, value=https://castjournals.cast.org.cn/joweb/kjdb/CN/file/pic, createTime=1753516664203, updateTime=1753516664203, creator=18614031015, updator=18614031015), WebsiteProps(id=1155895925731086511, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1155836763751993353, code=staticResourcePath, value=https://castjournals.cast.org.cn/joweb/cast_kjdb_cn_619/, createTime=1753516664202, updateTime=1753516664202, creator=18614031015, updator=18614031015)])], journalTitle=中国安全科学学报, weixinUrl=null, journalUrl=null, iacademicId=null, status=1, seqNo=null, journalTitleEn=China Safety Science Journal, journalPhotoCn=fkqsFM6VKlHC4gCtS5XqTw==, journalPhotoEn=SHn9HgqSxtJrOcAxqD++4Q==, journalFirstLetter=Z, journalRecommend=null, journalNew=null, journalCollection=1, jcrJf=null, cjcrJf=null, jcrJfStr=null, cjcrJfStr=null, submissionFirstDecision=null, sciSubjectClassification=null, casSubjectClassification=null, citeScore=null, totalCitationFrequency=null, icpCode=null, psCode=null, advertisingLicenseCode=null, copyrightInformation=null, country=null, option=, provinceCode=null, provinceName=null, collectFlag=false, interPubPlatform=, interPubPlatformUrl=null), detailUrlCn=https://castjournals.cast.org.cn/joweb/zgaqkxxb/CN/10.16265/j.cnki.issn1003-3033.2025.08.0084, detailUrlEn=https://castjournals.cast.org.cn/joweb/zgaqkxxb/EN/10.16265/j.cnki.issn1003-3033.2025.08.0084, pdfUrlCn=https://castjournals.cast.org.cn/joweb/zgaqkxxb/CN/PDF/10.16265/j.cnki.issn1003-3033.2025.08.0084, pdfUrlEn=https://castjournals.cast.org.cn/joweb/zgaqkxxb/EN/PDF/10.16265/j.cnki.issn1003-3033.2025.08.0084, aliStartDate=0, aliEndDate=0, collectionFlag=false, citedCount=null, citedUrl=null, previewStatus=0, delFlag=0, hasFullText=0, orderTime=1756310400000, fullTextJson=null, articleText=null, reference=null)
收藏切换
工业场景下人员行为的多模态信息融合决策策略
收藏切换
PDF下载
王海泉教授 1 , 于浩玮 2 , 杨岳毅讲师 1 , 徐晓滨教授 3 , 卜祥洲高级工程师 4 , KURKOVAP   教授 5
中国安全科学学报 | 安全工程技术 2025,35(8): 84-92
收起
收藏切换
中国安全科学学报 |安全工程技术 2025 , 35 (8) : 84 -92
工业场景下人员行为的多模态信息融合决策策略
全屏
[Author(id=1282030050665021907, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, orderNo=0, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=wanghq@zut.edu.cn, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1282030050782462421, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, authorId=1282030050665021907, language=EN, stringName=Haiquan WANG, firstName=Haiquan, middleName=null, lastName=WANG, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, address=1College of Intelligent Sensing and Instrumentation, Zhongyuan University of Technology, Zhengzhou Henan 450007, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1282030050857959895, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, authorId=1282030050665021907, language=CN, stringName=王海泉教授, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, address=1中原工学院 智能感知与仪器学院,河南 郑州 450007, bio={"content":"

王海泉(1981—),男,河南郑州人,博士,教授,硕士生导师,主要从事多模态数据挖掘技术、故障诊断等方面的研究。E-mail:

"}, bioImg=null, bioContent=

王海泉(1981—),男,河南郑州人,博士,教授,硕士生导师,主要从事多模态数据挖掘技术、故障诊断等方面的研究。E-mail:

, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1282030050178482627, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, xref=1, ext=[AuthorCompanyExt(id=1282030050186871236, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, companyId=1282030050178482627, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1College of Intelligent Sensing and Instrumentation, Zhongyuan University of Technology, Zhengzhou Henan 450007, China), AuthorCompanyExt(id=1282030050199454149, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, companyId=1282030050178482627, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1中原工学院 智能感知与仪器学院,河南 郑州 450007)])]), Author(id=1282030050941845977, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, orderNo=1, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1282030051050897883, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, authorId=1282030050941845977, language=EN, stringName=Haowei YU, firstName=Haowei, middleName=null, lastName=YU, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=2, address=2School of Automation and Electrical Engineering, Zhongyuan University of Technology, Zhengzhou Henan 450007, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1282030051130589660, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, authorId=1282030050941845977, language=CN, stringName=于浩玮, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=2, address=2中原工学院 自动化与电气工程学院,河南 郑州 450007, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1282030050291728838, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, xref=2, ext=[AuthorCompanyExt(id=1282030050308506055, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, companyId=1282030050291728838, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2School of Automation and Electrical Engineering, Zhongyuan University of Technology, Zhengzhou Henan 450007, China), AuthorCompanyExt(id=1282030050321088968, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, companyId=1282030050291728838, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2中原工学院 自动化与电气工程学院,河南 郑州 450007)])]), Author(id=1282030051252224478, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, orderNo=2, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1282030051319333344, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, authorId=1282030051252224478, language=EN, stringName=Yueyi YANG, firstName=Yueyi, middleName=null, lastName=YANG, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, address=1College of Intelligent Sensing and Instrumentation, Zhongyuan University of Technology, Zhengzhou Henan 450007, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1282030051390636513, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, authorId=1282030051252224478, language=CN, stringName=杨岳毅讲师, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, address=1中原工学院 智能感知与仪器学院,河南 郑州 450007, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1282030050178482627, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, xref=1, ext=[AuthorCompanyExt(id=1282030050186871236, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, companyId=1282030050178482627, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1College of Intelligent Sensing and Instrumentation, Zhongyuan University of Technology, Zhengzhou Henan 450007, China), AuthorCompanyExt(id=1282030050199454149, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, companyId=1282030050178482627, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1中原工学院 智能感知与仪器学院,河南 郑州 450007)])]), Author(id=1282030053047386595, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, orderNo=3, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1282030053127078373, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, authorId=1282030053047386595, language=EN, stringName=Xiaobin XU, firstName=Xiaobin, middleName=null, lastName=XU, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=3, address=3College of Automation, Hangzhou Dianzi University, Hangzhou Zhejiang 310018, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1282030053215158758, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, authorId=1282030053047386595, language=CN, stringName=徐晓滨教授, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=3, address=3杭州电子科技大学 自动化学院,浙江 杭州 310018, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1282030050388197833, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, xref=3, ext=[AuthorCompanyExt(id=1282030050392392138, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, companyId=1282030050388197833, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=3College of Automation, Hangzhou Dianzi University, Hangzhou Zhejiang 310018, China), AuthorCompanyExt(id=1282030050400780747, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, companyId=1282030050388197833, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=3杭州电子科技大学 自动化学院,浙江 杭州 310018)])]), Author(id=1282030053299044840, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, orderNo=4, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1282030053374542314, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, authorId=1282030053299044840, language=EN, stringName=Xiangzhou BU, firstName=Xiangzhou, middleName=null, lastName=BU, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=4, address=4Henan Hongbo Measurment and Control Co., Ltd., Zhengzhou Henan 450040, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1282030053512954347, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, authorId=1282030053299044840, language=CN, stringName=卜祥洲高级工程师, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=4, address=4河南宏博测控技术有限公司,河南 郑州 450040, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1282030050463695308, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, xref=4, ext=[AuthorCompanyExt(id=1282030050476278221, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, companyId=1282030050463695308, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=4Henan Hongbo Measurment and Control Co., Ltd., Zhengzhou Henan 450040, China), AuthorCompanyExt(id=1282030050480472526, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, companyId=1282030050463695308, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=4河南宏博测控技术有限公司,河南 郑州 450040)])]), Author(id=1282030053617811949, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, orderNo=5, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1282030053697503727, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, authorId=1282030053617811949, language=EN, stringName=P KURKOVA, firstName=P, middleName=null, lastName=KURKOVA, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=5, address=5School of Electronic and Laser Instrument, Saint Petersburg State University of Aerospace Instrumentation, Saint Petersburg 14-51, Russia, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1282030053773001200, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, authorId=1282030053617811949, language=CN, stringName=KURKOVAP, firstName=P, middleName=null, lastName=KURKOVA, prefix=null, suffix=教授, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=5, address=5圣彼得堡国立宇航与仪器制造大学 电子与激光仪器系,俄罗斯 圣彼得堡 14-51, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1282030050560164303, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, xref=5, ext=[AuthorCompanyExt(id=1282030050568552912, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, companyId=1282030050560164303, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=5School of Electronic and Laser Instrument, Saint Petersburg State University of Aerospace Instrumentation, Saint Petersburg 14-51, Russia), AuthorCompanyExt(id=1282030050589524433, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282030049167655358, companyId=1282030050560164303, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=5圣彼得堡国立宇航与仪器制造大学 电子与激光仪器系,俄罗斯 圣彼得堡 14-51)])])]
王海泉教授1 , 于浩玮2, 杨岳毅讲师1, 徐晓滨教授3, 卜祥洲高级工程师4, KURKOVAP 教授5
作者信息
  • 1中原工学院 智能感知与仪器学院,河南 郑州 450007
  • 2中原工学院 自动化与电气工程学院,河南 郑州 450007
  • 3杭州电子科技大学 自动化学院,浙江 杭州 310018
  • 4河南宏博测控技术有限公司,河南 郑州 450040
  • 5圣彼得堡国立宇航与仪器制造大学 电子与激光仪器系,俄罗斯 圣彼得堡 14-51
作者简介:

王海泉(1981—),男,河南郑州人,博士,教授,硕士生导师,主要从事多模态数据挖掘技术、故障诊断等方面的研究。E-mail:

Multimodal information fusion decision-making strategy for personnel behavior in industrial scene
Haiquan WANG1 , Haowei YU2, Yueyi YANG1, Xiaobin XU3, Xiangzhou BU4, P KURKOVA5
Affiliations
  • 1College of Intelligent Sensing and Instrumentation, Zhongyuan University of Technology, Zhengzhou Henan 450007, China
  • 2School of Automation and Electrical Engineering, Zhongyuan University of Technology, Zhengzhou Henan 450007, China
  • 3College of Automation, Hangzhou Dianzi University, Hangzhou Zhejiang 310018, China
  • 4Henan Hongbo Measurment and Control Co., Ltd., Zhengzhou Henan 450040, China
  • 5School of Electronic and Laser Instrument, Saint Petersburg State University of Aerospace Instrumentation, Saint Petersburg 14-51, Russia
出版时间: 2025-08-28 doi: 10.16265/j.cnki.issn1003-3033.2025.08.0084
文章导航
收藏切换

为预防工业场景下人员不安全生产行为所导致的安全事故,解决光线不佳、视野受限和遮挡等干扰情况下单一视觉模态动作识别效果不佳的问题,提出一种基于自适应证据推理(S-ER)策略,融合视频信息和惯性测量元件(IMU)信息的人员不安全行为决策方法。首先,构建基于注意力机制的多任务三维卷积模型(M-C3D),分析视频信息,运用融合注意力机制的一维卷积神经网络(1D-CNN)处理IMU信息;其次,运用证据推理(ER)策略实现决策级融合,并通过萤火虫优化算法构建不同环境条件下证据权重和可靠度的优化集合,确保视频和传感器模态信息的权重能够根据环境情况自适应调整;最后,通过德克萨斯大学达拉斯分校的多模态人员行为数据集(UTD-MHAD)和中原工学院的多模态人员行为数据集(ZUT-MHAD)验证模型的有效性。结果表明:在存在干扰的工业场景中,S-ER方法的识别准确率最高可达98.53%,较传统多模态融合方法及单模态识别方法的最高值提升17.52%。

工业场景  /  多模态信息  /  信息融合  /  行为识别  /  证据推理(ER)策略

In order to reduce the accidents in industrial scenarios which were caused by workers'unsafe operation behaviors, meanwhile improve the performance of visual-based action recognition methods in industrial scene with poor lighting, limited field of view and occlusions, an improved decision-making strategy based on self-adaptive ER (S-ER) was introduced in this paper. This strategy could integrate video information and inertial measurement unit (IMU) information effectively. It firstly analyzed video information and IMU information with attention mechanism-based multi-task convolutional 3D (M-C3D) model as well as one-dimensional convolutional neural network (1D-CNN) fused with attention mechanism, then ER theory was introduced to achieve decision-level fusion, where the set of evidence weights and reliability under different environmental conditions was optimized through the firefly optimization algorithm for improving the recognition accuracy and robustness of the model. The effectiveness of the proposed algorithm was verified on the public dataset Multimodal Human Action Dataset from University of Texas at Dallas(UTD-MHAD) and the self-built dataset Multimodal Human Action Dataset from Zhongyuan University of Technology(ZUT-MHAD). The results show that the identification results of S-ER for workers'unsafe behaviors in complex industrial scenarios can reach up to 98.53%, which is 17.52% higher than the maximum value of traditional multimodal fusion methods and single-modality recognition methods.

industrial scene  /  multimodal information  /  information fusion  /  action recognition  /  evidence reasoning (ER) theory
王海泉教授, 于浩玮, 杨岳毅讲师, 徐晓滨教授, 卜祥洲高级工程师, KURKOVAP. 工业场景下人员行为的多模态信息融合决策策略. 中国安全科学学报, 2025 , 35 (8) : 84 -92 . DOI: 10.16265/j.cnki.issn1003-3033.2025.08.0084
Haiquan WANG, Haowei YU, Yueyi YANG, Xiaobin XU, Xiangzhou BU, P KURKOVA. Multimodal information fusion decision-making strategy for personnel behavior in industrial scene[J]. China Safety Science Journal, 2025 , 35 (8) : 84 -92 . DOI: 10.16265/j.cnki.issn1003-3033.2025.08.0084
  • 河南重点研发专项项目(251111211600)
  • 河南省科技攻关项目(242102320215)
  • 河南省高端外国专家引进计划项目(HNGD2024032)
  • 中原工学院学科实力提升计划项目(GG202412)
参考文献 引证文献
排序方式:
2025年第35卷第8期
PDF下载
59
7
引用本文
BibTeX
文章信息
doi: 10.16265/j.cnki.issn1003-3033.2025.08.0084
  • 接收时间:2025-03-01
  • 首发时间:2026-07-09
  • 出版时间:2025-08-28
补充材料
相关文章
文章信息
作者
出版历史
  • 收稿日期:2025-03-01
  • 修回日期:2025-05-13
基金
河南重点研发专项项目(251111211600)
河南省科技攻关项目(242102320215)
河南省高端外国专家引进计划项目(HNGD2024032)
中原工学院学科实力提升计划项目(GG202412)
作者信息
    1中原工学院 智能感知与仪器学院,河南 郑州 450007
    2中原工学院 自动化与电气工程学院,河南 郑州 450007
    3杭州电子科技大学 自动化学院,浙江 杭州 310018
    4河南宏博测控技术有限公司,河南 郑州 450040
    5圣彼得堡国立宇航与仪器制造大学 电子与激光仪器系,俄罗斯 圣彼得堡 14-51
参考文献
分享链接
https://castjournals.cast.org.cn/joweb/zgaqkxxb/CN/10.16265/j.cnki.issn1003-3033.2025.08.0084
分享至
全文二维码

扫描看全文

引用本文
BibTeX
本文的引用情况
2种不同金属材料的力学参数

Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)

Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏