Article(id=1282036039640400362, tenantId=1146029695717560320, journalId=1146031787341344770, issueId=1282036038860255373, articleNumber=null, orderNo=null, doi=10.16265/j.cnki.issn1003-3033.2025.11.0357, pmid=null, cstr=null, oa=null, hot=null, price=null, onlineType=0, articleFormat=0, articleType=null, articleTypeStr=null, receivedDate=1749225600000, receivedDateStr=2025-06-07, revisedDate=1757433600000, revisedDateStr=2025-09-10, acceptedDate=null, acceptedDateStr=null, onlineDate=1783590810927, onlineDateStr=2026-07-09, pubDate=1764259200000, pubDateStr=2025-11-28, doiRegisterDate=null, doiRegisterDateStr=null, onlineIssueDate=1783590810927, onlineIssueDateStr=2026-07-09, onlineJustAcceptDate=null, onlineJustAcceptDateStr=null, onlineFirstDate=null, onlineFirstDateStr=null, sourceXml=null, magXml=null, createTime=1783590810927, creator=13701087609, updateTime=1783590810927, updator=13701087609, issue=Issue{id=1282036038860255373, tenantId=1146029695717560320, journalId=1146031787341344770, year='2025', volume='35', issue='11', pageStart='1', pageEnd='268', issueExtLink='null', onlineDate='null', pubDate='1764259200000', pubDateStr='2025-11-28', beforeIssueId=null, nextIssueId=null, price=null, status=1, issueComplete=1, articleOrder=1, issueType=-1, specialIssue=null, createTime=1783590810742, creator='13701087609', updateTime=1783593801313, updator='13701087609', preIssue=null, nextIssue=null, articleTotal=null, ext={EN=IssueExt(id=1282048582291276616, tenantId=1146029695717560320, journalId=1146031787341344770, issueId=1282036038860255373, language=EN, specialIssueTitle=, coverIllustrator=null, specialIssueEditor=, specialIssueAbout=), CN=IssueExt(id=1282048582295470921, tenantId=1146029695717560320, journalId=1146031787341344770, issueId=1282036038860255373, language=CN, specialIssueTitle=, coverIllustrator=null, specialIssueEditor=, specialIssueAbout=)}, issueFiles=null, downloadFileDto=null}, startPage=32, endPage=41, ext={EN=ArticleExt(id=1282036039841726955, articleId=1282036039640400362, tenantId=1146029695717560320, journalId=1146031787341344770, language=EN, title=Unsafe behavior recognition of miners in coal mine belt area based on multimodal feature fusion, columnId=1149733271128420907, journalTitle=China Safety Science Journal, columnName=Safety social science and safety management, runingTitle=null, highlight=null, articleAbstract=

To enhance the accuracy and robustness of miner behavior recognition in underground belt conveyor areas and reduce the occurrence of unsafe behaviors, a multimodal feature fusion-based recognition method was proposed. The method integrated RGB and skeletal modalities, where an improved Efficient Attention(EA)-SlowFast networkwas employed to extract RGB features, and an improved Mobile-Enhanced(ME)-YOLO was utilized for miner detection. The detected miners were subsequently processed by Lite-HRNet for pose estimation to extract skeletal keypoints, which were further encoded using an improved Depthwise Convolution and Channel Prior Attention Spatio-Temporal Graph Convolutional Network (DC-STGCN) to obtain skeletal features. Finally, late fusion of RGB and skeletal features was performed for unsafe behavior recognition. In the experimental design, both public datasets (Human Motion Database 51(HMDB51), University of Central Florida 101 Action Recognition Dataset(UCF101)) and a self-constructed underground coal mine unsafe behavior dataset were adopted for validation. The results demonstrate that, compared with single-modal baseline models, EA-SlowFast and DC-STGCN achieve recognition accuracies of 71.6% and 68.3% on HMDB51, and 88.3% and 85.4% on UCF101, respectively. The multimodal fusion model outperforms the unimproved fusion baseline, achieving 75.4% and 93.5% on HMDB51 and UCF101, respectively. On the self-constructed dataset, ME--YOLO attains a Mean Average Precision(mAP)@0.5 of 91.8% with an inference speed of 38 f/s, satisfying real-time requirements. The fusion model further achieves an accuracy of 90.6%, confirming the effectiveness of the proposed approach in complex underground belt conveyor environments.

, authors=Qinxia HAO, Haolong ZHEN, authorsList=Qinxia HAO, Haolong ZHEN, authorCompany=null, correspAuthors=null, authorNote=null, correspAuthorsNote=null, copyrightStatement=null, copyrightOwner=null, extLink=null, articleAbsUrl=null, sourceXml=null, magXml=null, pdfUrl=null, pdf=null, pdfFileSize=null, pdfExtLink=null, richHtmlUrl=null, mobilePdfUrl=null, reviewReport=null, pdfFirstPage=null, abstractGraph=null, abstractGraphContent=null, abstractVideo=null, citation=null, cebUrl=null, magXmlContent=null, mapNumber=null, fund=null), CN=ArticleExt(id=1282036040487649772, articleId=1282036039640400362, tenantId=1146029695717560320, journalId=1146031787341344770, language=CN, title=基于多模态融合的煤矿输送带运输区矿工不安全行为识别, columnId=1149733271296193071, journalTitle=中国安全科学学报, columnName=安全社会科学与安全管理, runingTitle=null, highlight=null, articleAbstract=

为提高煤矿输送带运输区矿工行为识别的准确性和鲁棒性,降低不安全行为发生概率,提出一种基于多模态特征融合的不安全行为识别方法。首先,结合红绿蓝(RGB)与骨骼2种模态,通过基于高效注意力机制(EA)改进的SlowFast网络(EA-SlowFast)提取RGB模态特征,并利用改进后的移动增强型(ME)YOLO(ME-YOLO)检测矿工目标;然后,对检测到的矿工送入Lite-HRNet进行姿态估计,提取骨骼关键点数据,再通过深度通道卷积注意力时空图卷积网络(DC-STGCN)提取骨骼模态特征,实现RGB模态与骨骼模态的晚期融合;最后,分别选取公开数据集(人类动作数据库51(HMDB51)、中佛罗里达大学101类动作识别数据集(UCF101))与自建煤矿井下不安全行为数据集进行试验验证。结果表明:相较于单一模态基准模型,EA-SlowFast与DC-STGCN在HMDB51数据集上的识别准确率分别为71.6%和68.3%,在UCF101动作识别数据集上的识别准确率分别为88.3%和85.4%;多模态特征融合模型的识别准确率较未改进的融合模型有所提升,在HMDB51和UCF101数据集上分别达到75.4%和93.5%。在自建数据集上,ME-YOLO的平均检测精度(mAP)@0.5为91.8%,推理速度为38帧/s,满足实时性需求。融合模型的识别准确率达到90.6%,验证了该方法在煤矿输送带运输区环境中的有效性。

, authors=郝秦霞副教授, 甄浩龙, authorsList=郝秦霞副教授, 甄浩龙, authorCompany=null, correspAuthors=null, authorNote=

郝秦霞(1980—),女,陕西西安人,博士,副教授,主要从事物联网工程应用,煤矿安全方面的研究。E-mail:

, correspAuthorsNote=null, copyrightStatement=null, copyrightOwner=null, extLink=null, articleAbsUrl=null, sourceXml=Zi+OrDdN+vYoByRJnM6u7w==, magXml=aivv4kNCWEqGEv7pnwrrVg==, pdfUrl=null, pdf=6/kzJrSbQ2yKgkdWiECL9w==, pdfFileSize=7864218, pdfExtLink=null, richHtmlUrl=null, mobilePdfUrl=null, reviewReport=null, pdfFirstPage=null, abstractGraph=null, abstractGraphContent=null, abstractVideo=null, citation=null, cebUrl=null, magXmlContent=nRxYtf8rlvHBHjE86M9kCQ==, mapNumber=null, fund=null)}, authors=[Author(id=1282036040944828914, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282036039640400362, orderNo=0, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=haoqinxia@xust.exu.cn, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1282036041024520692, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282036039640400362, authorId=1282036040944828914, language=EN, stringName=Qinxia HAO, firstName=Qinxia, middleName=null, lastName=HAO, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=School of Communication and Information Engineering, Xi'an University of Science and Technology, Xi'an Shaanxi 710054, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1282036041116795381, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282036039640400362, authorId=1282036040944828914, language=CN, stringName=郝秦霞副教授, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=西安科技大学 通信与信息工程学院,陕西 西安 710054, bio={"content":"

郝秦霞(1980—),女,陕西西安人,博士,副教授,主要从事物联网工程应用,煤矿安全方面的研究。E-mail:

"}, bioImg=null, bioContent=

郝秦霞(1980—),女,陕西西安人,博士,副教授,主要从事物联网工程应用,煤矿安全方面的研究。E-mail:

, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1282036040835777006, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282036039640400362, xref=null, ext=[AuthorCompanyExt(id=1282036040844165615, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282036039640400362, companyId=1282036040835777006, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=School of Communication and Information Engineering, Xi'an University of Science and Technology, Xi'an Shaanxi 710054, China), AuthorCompanyExt(id=1282036040856748528, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282036039640400362, companyId=1282036040835777006, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=西安科技大学 通信与信息工程学院,陕西 西安 710054)])]), Author(id=1282036041175515639, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282036039640400362, orderNo=1, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1282036041259401721, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282036039640400362, authorId=1282036041175515639, language=EN, stringName=Haolong ZHEN, firstName=Haolong, middleName=null, lastName=ZHEN, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=School of Communication and Information Engineering, Xi'an University of Science and Technology, Xi'an Shaanxi 710054, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1282036041326510586, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282036039640400362, authorId=1282036041175515639, language=CN, stringName=甄浩龙, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=西安科技大学 通信与信息工程学院,陕西 西安 710054, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1282036040835777006, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282036039640400362, xref=null, ext=[AuthorCompanyExt(id=1282036040844165615, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282036039640400362, companyId=1282036040835777006, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=School of Communication and Information Engineering, Xi'an University of Science and Technology, Xi'an Shaanxi 710054, China), AuthorCompanyExt(id=1282036040856748528, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282036039640400362, companyId=1282036040835777006, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=西安科技大学 通信与信息工程学院,陕西 西安 710054)])])], keywords=[Keyword(id=1282036041422979579, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282036039640400362, language=EN, orderNo=1, keyword=multimodal), Keyword(id=1282036041490088444, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282036039640400362, language=EN, orderNo=2, keyword=feature fusion), Keyword(id=1282036041573974525, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282036039640400362, language=EN, orderNo=3, keyword=coal mine belt area), Keyword(id=1282036041657860606, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282036039640400362, language=EN, orderNo=4, keyword=unsafe behaviors of miners), Keyword(id=1282036041737552383, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282036039640400362, language=EN, orderNo=5, keyword=object detection), Keyword(id=1282036043369136640, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282036039640400362, language=EN, orderNo=6, keyword=red-green-blue(RGB) modality), Keyword(id=1282036043436245505, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282036039640400362, language=EN, orderNo=7, keyword=skeleton modality), Keyword(id=1282036043515937282, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282036039640400362, language=CN, orderNo=1, keyword=多模态), Keyword(id=1282036043578851843, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282036039640400362, language=CN, orderNo=2, keyword=特征融合), Keyword(id=1282036043683709444, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282036039640400362, language=CN, orderNo=3, keyword=煤矿输送带运输区), Keyword(id=1282036043755012613, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282036039640400362, language=CN, orderNo=4, keyword=矿工不安全行为), Keyword(id=1282036043826315782, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282036039640400362, language=CN, orderNo=5, keyword=目标检测), Keyword(id=1282036043906007559, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282036039640400362, language=CN, orderNo=6, keyword=红绿蓝(RGB)模态), Keyword(id=1282036043985699336, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282036039640400362, language=CN, orderNo=7, keyword=骨骼模态)], refs=null, funds=[Fund(id=1282036044103139849, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282036039640400362, awardId=2024GX-YBXM-526, language=CN, fundingSource=陕西省重点研发计划(2024GX-YBXM-526), fundOrder=null, country=null)], companyList=[AuthorCompany(id=1282036040835777006, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282036039640400362, xref=null, ext=[AuthorCompanyExt(id=1282036040844165615, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282036039640400362, companyId=1282036040835777006, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=School of Communication and Information Engineering, Xi'an University of Science and Technology, Xi'an Shaanxi 710054, China), AuthorCompanyExt(id=1282036040856748528, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282036039640400362, companyId=1282036040835777006, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=西安科技大学 通信与信息工程学院,陕西 西安 710054)])], figs=null, attaches=null, journal=Journal(id=1123942128916217864, delFlag=0, nameCn=中国安全科学学报, nameEn=China Safety Science Journal, nameHistory1=null, nameHistory2=null, issn=1003-3033, eissn=, cn=11-2865/X, coden=null, periodic=0, language=CN, oaType=0, ccby=null, superviseOffice=null, ownerOffice=null, pubOffice=null, editorOffice=null, officeType=null, aims=null, clcCode=null, officeProv=null, officeCity=null, officeAddr=null, officeZip=null, officeEmail=null, officePhone=null, editDirector=null, officeDirector=null, officeDirectorPhone=null, officeStaffNum=null, officeEmpNum=null, coverPicUrl=fkqsFM6VKlHC4gCtS5XqTw==, journalPrice=null, startedYear=null, abbrevIsoEn=Chin Saf Sci J, journalRemark=null, publicationField=null, createdTime=null, updatedTime=1784015834644, createdBy=null, updatedBy=13041195026, firstLetterCn=Z, firstLetterEn=Z, subjectCode=Engineering, subjectName=工程, subjectCodeEn=Engineering, subjectNameEn=null, picCn=fkqsFM6VKlHC4gCtS5XqTw==, picEn=SHn9HgqSxtJrOcAxqD++4Q==, jcr=null, cjcr=null, exts=[JournalExt(id=1283818719495308010, language=CN, name=中国安全科学学报, nameHistory1=null, nameHistory2=null, managedBy=中国科学技术协会, sponsoredBy=中国职业安全健康协会, publishedBy=《中国安全科学学报》编辑部, editorOffice=, officeProv=null, officeCity=null, officeAddr=, officeZip=, editDirector=, officeDirector=null, officePhone=null, coverPicUrl=null, journalRemark=, submitArticleUrl=null, websiteUrl=http://www.cssjj.com.cn/, createdTime=1784015834926, updatedTime=1784015834926, createdBy=13041195026, updatedBy=13041195026, submissionGuidelinesUrl=http://www.cssjj.com.cn/CN/column/item15.shtml, submissionAuthorUrl=https://zgaqkxxbauthor.manuscriptcloud.com/login, submissionEditorUrl=https://zgaqkxxbeditor.manuscriptcloud.com/login, submissionReviewUrl=https://zgaqkxxbauthor.manuscriptcloud.com/login, submissionCeEditorUrl=https://zgaqkxxbeditor.manuscriptcloud.com/login, submissionAeEditorUrl=https://zgaqkxxbeditor.manuscriptcloud.com/login, option={"copyright":""}), JournalExt(id=1283818719541445355, language=EN, name=China Safety Science Journal, nameHistory1=null, nameHistory2=null, managedBy=, sponsoredBy=, publishedBy=, editorOffice=, officeProv=null, officeCity=null, officeAddr=, officeZip=, editDirector=, officeDirector=null, officePhone=null, coverPicUrl=null, journalRemark=, submitArticleUrl=null, websiteUrl=http://www.cssjj.com.cn/EN/1003-3033/home.shtml, createdTime=1784015834937, updatedTime=1784015834937, createdBy=13041195026, updatedBy=13041195026, submissionGuidelinesUrl=https://synbioj.cip.com.cn/EN/column/column3.shtml, submissionAuthorUrl=https://zgaqkxxbauthor.manuscriptcloud.com/login, submissionEditorUrl=https://zgaqkxxbeditor.manuscriptcloud.com/login, submissionReviewUrl=https://zgaqkxxbauthor.manuscriptcloud.com/login, submissionCeEditorUrl=https://zgaqkxxbeditor.manuscriptcloud.com/login, submissionAeEditorUrl=https://zgaqkxxbeditor.manuscriptcloud.com/login, option={"copyright":""})], databaseList=null, tenantJournalId=1146031787341344770, websiteList=[Website(id=1148243202345263519, webName=null, webTitle=null, webDomain=null, webCopyrigh=null, webIpcNo=null, seoTitle=null, seoKeywords=null, seoDescription=null, tenantJournalId=null, journalId=1146031787341344770, journalNameCn=null, journalNameEn=null, grayFlag=null, tenantId=1146029695717560320, platformId=null, journalGroupId=null, journalGroupNameCn=null, journalGroupNameEn=null, type=1, domain=https://castjournals.cast.org.cn/joweb/zgaqkxxb/CN, language=CN, createTime=1751692112766, createBy=18614031015, updateTime=1753502583634, updateBy=18614031015, name=《中国安全科学学报》中文站点, tplId=1146099689490845704, title=中国安全科学学报, delFlag=0, indexPage=/home, props=[WebsiteProps(id=1148618794941046792, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1148243202345263519, code=articleTextType, value=kx, createTime=1751781661020, updateTime=1751781661020, creator=18614031015, updator=18614031015), WebsiteProps(id=1148618794911686661, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1148243202345263519, code=banner, value=null, createTime=1751781661012, updateTime=1751781661012, creator=18614031015, updator=18614031015), WebsiteProps(id=1148618794894909444, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1148243202345263519, code=logo, value=https://castjournals.cast.org.cn/joweb/kjdb/CN/file/pic?fileId=tui0IVO9FMwB61HHtX5scg==, createTime=1751781661008, updateTime=1751781661008, creator=18614031015, updator=18614031015), WebsiteProps(id=1148618794932658183, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1148243202345263519, code=picServerUrl, value=https://castjournals.cast.org.cn/joweb/kjdb/CN/file/pic, createTime=1751781661017, updateTime=1751781661017, creator=18614031015, updator=18614031015), WebsiteProps(id=1148618794924269574, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1148243202345263519, code=staticResourcePath, value=https://castjournals.cast.org.cn/joweb/cast_kjdb_cn_619/, createTime=1751781661015, updateTime=1751781661015, creator=18614031015, updator=18614031015)]), Website(id=1155836763751993353, webName=null, webTitle=null, webDomain=null, webCopyrigh=null, webIpcNo=null, seoTitle=null, seoKeywords=null, seoDescription=null, tenantJournalId=null, journalId=1146031787341344770, journalNameCn=null, journalNameEn=null, grayFlag=null, tenantId=1146029695717560320, platformId=null, journalGroupId=null, journalGroupNameCn=null, journalGroupNameEn=null, type=1, domain=https://castjournals.cast.org.cn/joweb/zgaqkxxb/EN, language=EN, createTime=1753502558893, createBy=18614031015, updateTime=1753524450387, updateBy=18614031015, name=《中国安全科学学报》英文站点, tplId=1146101810881728533, title=China Safety Science Journal, delFlag=0, indexPage=/home, props=[WebsiteProps(id=1155895925743669425, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1155836763751993353, code=articleTextType, value=kx, createTime=1753516664205, updateTime=1753516664205, creator=18614031015, updator=18614031015), WebsiteProps(id=1155895925722697902, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1155836763751993353, code=banner, value=null, createTime=1753516664200, updateTime=1753516664200, creator=18614031015, updator=18614031015), WebsiteProps(id=1155895925714309293, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1155836763751993353, code=logo, value=https://castjournals.cast.org.cn/joweb/kjdb/CN/file/pic?fileId=tui0IVO9FMwB61HHtX5scg==, createTime=1753516664198, updateTime=1753516664198, creator=18614031015, updator=18614031015), WebsiteProps(id=1155895925735280816, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1155836763751993353, code=picServerUrl, value=https://castjournals.cast.org.cn/joweb/kjdb/CN/file/pic, createTime=1753516664203, updateTime=1753516664203, creator=18614031015, updator=18614031015), WebsiteProps(id=1155895925731086511, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1155836763751993353, code=staticResourcePath, value=https://castjournals.cast.org.cn/joweb/cast_kjdb_cn_619/, createTime=1753516664202, updateTime=1753516664202, creator=18614031015, updator=18614031015)])], journalTitle=中国安全科学学报, weixinUrl=null, journalUrl=null, iacademicId=null, status=1, seqNo=null, journalTitleEn=China Safety Science Journal, journalPhotoCn=fkqsFM6VKlHC4gCtS5XqTw==, journalPhotoEn=SHn9HgqSxtJrOcAxqD++4Q==, journalFirstLetter=Z, journalRecommend=null, journalNew=null, journalCollection=1, jcrJf=null, cjcrJf=null, jcrJfStr=null, cjcrJfStr=null, submissionFirstDecision=null, sciSubjectClassification=null, casSubjectClassification=null, citeScore=null, totalCitationFrequency=null, icpCode=null, psCode=null, advertisingLicenseCode=null, copyrightInformation=null, country=null, option=, provinceCode=null, provinceName=null, collectFlag=false, interPubPlatform=, interPubPlatformUrl=null), detailUrlCn=https://castjournals.cast.org.cn/joweb/zgaqkxxb/CN/10.16265/j.cnki.issn1003-3033.2025.11.0357, detailUrlEn=https://castjournals.cast.org.cn/joweb/zgaqkxxb/EN/10.16265/j.cnki.issn1003-3033.2025.11.0357, pdfUrlCn=https://castjournals.cast.org.cn/joweb/zgaqkxxb/CN/PDF/10.16265/j.cnki.issn1003-3033.2025.11.0357, pdfUrlEn=https://castjournals.cast.org.cn/joweb/zgaqkxxb/EN/PDF/10.16265/j.cnki.issn1003-3033.2025.11.0357, aliStartDate=0, aliEndDate=0, collectionFlag=false, citedCount=null, citedUrl=null, previewStatus=0, delFlag=0, hasFullText=0, orderTime=1764259200000, fullTextJson=null, articleText=null, reference=null)
收藏切换
基于多模态融合的煤矿输送带运输区矿工不安全行为识别
收藏切换
PDF下载
郝秦霞副教授 , 甄浩龙
中国安全科学学报 | 安全社会科学与安全管理 2025,35(11): 32-41
收起
收藏切换
中国安全科学学报 |安全社会科学与安全管理 2025 , 35 (11) : 32 -41
基于多模态融合的煤矿输送带运输区矿工不安全行为识别
全屏
[Author(id=1282036040944828914, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282036039640400362, orderNo=0, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=haoqinxia@xust.exu.cn, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1282036041024520692, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282036039640400362, authorId=1282036040944828914, language=EN, stringName=Qinxia HAO, firstName=Qinxia, middleName=null, lastName=HAO, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=School of Communication and Information Engineering, Xi'an University of Science and Technology, Xi'an Shaanxi 710054, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1282036041116795381, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282036039640400362, authorId=1282036040944828914, language=CN, stringName=郝秦霞副教授, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=西安科技大学 通信与信息工程学院,陕西 西安 710054, bio={"content":"

郝秦霞(1980—),女,陕西西安人,博士,副教授,主要从事物联网工程应用,煤矿安全方面的研究。E-mail:

"}, bioImg=null, bioContent=

郝秦霞(1980—),女,陕西西安人,博士,副教授,主要从事物联网工程应用,煤矿安全方面的研究。E-mail:

, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1282036040835777006, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282036039640400362, xref=null, ext=[AuthorCompanyExt(id=1282036040844165615, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282036039640400362, companyId=1282036040835777006, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=School of Communication and Information Engineering, Xi'an University of Science and Technology, Xi'an Shaanxi 710054, China), AuthorCompanyExt(id=1282036040856748528, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282036039640400362, companyId=1282036040835777006, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=西安科技大学 通信与信息工程学院,陕西 西安 710054)])]), Author(id=1282036041175515639, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282036039640400362, orderNo=1, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1282036041259401721, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282036039640400362, authorId=1282036041175515639, language=EN, stringName=Haolong ZHEN, firstName=Haolong, middleName=null, lastName=ZHEN, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=School of Communication and Information Engineering, Xi'an University of Science and Technology, Xi'an Shaanxi 710054, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1282036041326510586, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282036039640400362, authorId=1282036041175515639, language=CN, stringName=甄浩龙, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=西安科技大学 通信与信息工程学院,陕西 西安 710054, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1282036040835777006, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282036039640400362, xref=null, ext=[AuthorCompanyExt(id=1282036040844165615, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282036039640400362, companyId=1282036040835777006, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=School of Communication and Information Engineering, Xi'an University of Science and Technology, Xi'an Shaanxi 710054, China), AuthorCompanyExt(id=1282036040856748528, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1282036039640400362, companyId=1282036040835777006, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=西安科技大学 通信与信息工程学院,陕西 西安 710054)])])]
郝秦霞副教授 , 甄浩龙
作者信息
  • 西安科技大学 通信与信息工程学院,陕西 西安 710054
作者简介:

郝秦霞(1980—),女,陕西西安人,博士,副教授,主要从事物联网工程应用,煤矿安全方面的研究。E-mail:

Unsafe behavior recognition of miners in coal mine belt area based on multimodal feature fusion
Qinxia HAO , Haolong ZHEN
Affiliations
  • School of Communication and Information Engineering, Xi'an University of Science and Technology, Xi'an Shaanxi 710054, China
出版时间: 2025-11-28 doi: 10.16265/j.cnki.issn1003-3033.2025.11.0357
文章导航
收藏切换

为提高煤矿输送带运输区矿工行为识别的准确性和鲁棒性,降低不安全行为发生概率,提出一种基于多模态特征融合的不安全行为识别方法。首先,结合红绿蓝(RGB)与骨骼2种模态,通过基于高效注意力机制(EA)改进的SlowFast网络(EA-SlowFast)提取RGB模态特征,并利用改进后的移动增强型(ME)YOLO(ME-YOLO)检测矿工目标;然后,对检测到的矿工送入Lite-HRNet进行姿态估计,提取骨骼关键点数据,再通过深度通道卷积注意力时空图卷积网络(DC-STGCN)提取骨骼模态特征,实现RGB模态与骨骼模态的晚期融合;最后,分别选取公开数据集(人类动作数据库51(HMDB51)、中佛罗里达大学101类动作识别数据集(UCF101))与自建煤矿井下不安全行为数据集进行试验验证。结果表明:相较于单一模态基准模型,EA-SlowFast与DC-STGCN在HMDB51数据集上的识别准确率分别为71.6%和68.3%,在UCF101动作识别数据集上的识别准确率分别为88.3%和85.4%;多模态特征融合模型的识别准确率较未改进的融合模型有所提升,在HMDB51和UCF101数据集上分别达到75.4%和93.5%。在自建数据集上,ME-YOLO的平均检测精度(mAP)@0.5为91.8%,推理速度为38帧/s,满足实时性需求。融合模型的识别准确率达到90.6%,验证了该方法在煤矿输送带运输区环境中的有效性。

多模态  /  特征融合  /  煤矿输送带运输区  /  矿工不安全行为  /  目标检测  /  红绿蓝(RGB)模态  /  骨骼模态

To enhance the accuracy and robustness of miner behavior recognition in underground belt conveyor areas and reduce the occurrence of unsafe behaviors, a multimodal feature fusion-based recognition method was proposed. The method integrated RGB and skeletal modalities, where an improved Efficient Attention(EA)-SlowFast networkwas employed to extract RGB features, and an improved Mobile-Enhanced(ME)-YOLO was utilized for miner detection. The detected miners were subsequently processed by Lite-HRNet for pose estimation to extract skeletal keypoints, which were further encoded using an improved Depthwise Convolution and Channel Prior Attention Spatio-Temporal Graph Convolutional Network (DC-STGCN) to obtain skeletal features. Finally, late fusion of RGB and skeletal features was performed for unsafe behavior recognition. In the experimental design, both public datasets (Human Motion Database 51(HMDB51), University of Central Florida 101 Action Recognition Dataset(UCF101)) and a self-constructed underground coal mine unsafe behavior dataset were adopted for validation. The results demonstrate that, compared with single-modal baseline models, EA-SlowFast and DC-STGCN achieve recognition accuracies of 71.6% and 68.3% on HMDB51, and 88.3% and 85.4% on UCF101, respectively. The multimodal fusion model outperforms the unimproved fusion baseline, achieving 75.4% and 93.5% on HMDB51 and UCF101, respectively. On the self-constructed dataset, ME--YOLO attains a Mean Average Precision(mAP)@0.5 of 91.8% with an inference speed of 38 f/s, satisfying real-time requirements. The fusion model further achieves an accuracy of 90.6%, confirming the effectiveness of the proposed approach in complex underground belt conveyor environments.

multimodal  /  feature fusion  /  coal mine belt area  /  unsafe behaviors of miners  /  object detection  /  red-green-blue(RGB) modality  /  skeleton modality
郝秦霞副教授, 甄浩龙. 基于多模态融合的煤矿输送带运输区矿工不安全行为识别. 中国安全科学学报, 2025 , 35 (11) : 32 -41 . DOI: 10.16265/j.cnki.issn1003-3033.2025.11.0357
Qinxia HAO, Haolong ZHEN. Unsafe behavior recognition of miners in coal mine belt area based on multimodal feature fusion[J]. China Safety Science Journal, 2025 , 35 (11) : 32 -41 . DOI: 10.16265/j.cnki.issn1003-3033.2025.11.0357
  • 陕西省重点研发计划(2024GX-YBXM-526)
参考文献 引证文献
排序方式:
2025年第35卷第11期
PDF下载
30
4
引用本文
BibTeX
文章信息
doi: 10.16265/j.cnki.issn1003-3033.2025.11.0357
  • 接收时间:2025-06-07
  • 首发时间:2026-07-09
  • 出版时间:2025-11-28
补充材料
相关文章
文章信息
作者
出版历史
  • 收稿日期:2025-06-07
  • 修回日期:2025-09-10
基金
陕西省重点研发计划(2024GX-YBXM-526)
作者信息
    西安科技大学 通信与信息工程学院,陕西 西安 710054
参考文献
分享链接
https://castjournals.cast.org.cn/joweb/zgaqkxxb/CN/10.16265/j.cnki.issn1003-3033.2025.11.0357
分享至
全文二维码

扫描看全文

引用本文
BibTeX
本文的引用情况
2种不同金属材料的力学参数

Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)

Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏