Article(id=1149738776303415546, tenantId=1146029695717560320, journalId=1146031787341344770, issueId=1149738762382524507, articleNumber=1003-3033(2024)07-0091-07, orderNo=null, doi=10.16265/j.cnki.issn1003-3033.2024.07.0135, pmid=null, cstr=null, oa=null, hot=null, price=null, onlineType=0, articleFormat=0, articleType=null, articleTypeStr=null, receivedDate=1704988800000, receivedDateStr=2024-01-12, revisedDate=1713715200000, revisedDateStr=2024-04-22, acceptedDate=null, acceptedDateStr=null, onlineDate=1752048685384, onlineDateStr=2025-07-09, pubDate=1722096000000, pubDateStr=2024-07-28, doiRegisterDate=null, doiRegisterDateStr=null, onlineIssueDate=1752048685384, onlineIssueDateStr=2025-07-09, onlineJustAcceptDate=null, onlineJustAcceptDateStr=null, onlineFirstDate=null, onlineFirstDateStr=null, sourceXml=null, magXml=null, createTime=1752048685384, creator=13701087609, updateTime=1752048685384, updator=13701087609, issue=Issue{id=1149738762382524507, tenantId=1146029695717560320, journalId=1146031787341344770, year='2024', volume='34', issue='7', pageStart='1', pageEnd='252', issueExtLink='null', onlineDate='null', pubDate='null', beforeIssueId=null, nextIssueId=null, price=null, status=1, issueComplete=1, articleOrder=1, issueType=-1, specialIssue=0, createTime=1752048682065, creator=13701087609, updateTime=1757316437713, updator=13701087609, preIssue=null, nextIssue=null, ext={EN=IssueExt(id=1171833331021824745, tenantId=1146029695717560320, journalId=1146031787341344770, issueId=1149738762382524507, language=EN, specialIssueTitle=, coverIllustrator=, specialIssueEditor=, specialIssueAbout=), CN=IssueExt(id=1171833331021824746, tenantId=1146029695717560320, journalId=1146031787341344770, issueId=1149738762382524507, language=CN, specialIssueTitle=, coverIllustrator=, specialIssueEditor=, specialIssueAbout=)}, issueFiles=null}, startPage=91, endPage=97, ext={EN=ArticleExt(id=1149738776492159228, articleId=1149738776303415546, tenantId=1146029695717560320, journalId=1146031787341344770, language=EN, title=Gas leak detection based on cross-attention multi-source data fusion, columnId=1149733269173878863, journalTitle=China Safety Science Journal, columnName=Safety engineering technology, runingTitle=null, highlight=null, articleAbstract=

In order to solve the problem of false alarms and missed alarms in pipeline gas leakage detection using a single sensor,timely warning and feedback of leakage status,a multi-source data fusion pipeline leakage detection method based on cross-attention was proposed. Firstly,the pre-trained ShuffleNetV2 model was used to extract spatial features from thermal imaging data. Then,a 1DCNN BiGRU model was constructed by combining a one-dimensional CNN (1DCNN) and a bidirectional gated recurrent unit (BiGRU) to extract temporal features from gas sensors. Finally,cross-attention was used to capture the spatiotemporal correlation of the data and obtain the feature representations of the two data sources. The residual method was used to connect the features and input them into the classification layer to obtain the recognition results. The results show that the constructed SCGA model has a gas recognition accuracy of 99.22%,and the loss value fluctuates between 0-0.04. Compared with support vector machines (SVM),1DCNN,and BiGRU models that only use gas sensor data,the accuracy is improved by at least 4.12%. Compared with MobileNetV3,ShuffleNetV2,and ResNet18 models that only use thermal image sensor data,the accuracy is improved by at least 1.14%. Compared with the multi-source data fusion model SCG,which simply connects temporal and spatial features,the accuracy is improved by 1%. It was verified that the SCGA model has high accuracy.

, correspAuthors=null, authorNote=null, correspAuthorsNote=null, copyrightStatement=null, copyrightOwner=null, extLink=null, articleAbsUrl=null, sourceXml=null, magXml=null, pdfUrl=null, pdf=null, pdfFileSize=null, pdfExtLink=null, richHtmlUrl=null, mobilePdfUrl=null, reviewReport=null, pdfFirstPage=null, abstractGraph=null, abstractGraphContent=null, abstractVideo=null, citation=null, cebUrl=null, magXmlContent=null, mapNumber=null, authorCompany=null, fund=null, authors=null, authorsList=Xinying WANG, Yang YANG, Haojie TIAN, Yan CHEN, Min ZHANG), CN=ArticleExt(id=1149738786441048716, articleId=1149738776303415546, tenantId=1146029695717560320, journalId=1146031787341344770, language=CN, title=基于交叉注意力的多源数据融合的气体泄漏检测, columnId=1149733269727526997, journalTitle=中国安全科学学报, columnName=安全工程技术, runingTitle=null, highlight=null, articleAbstract=

为解决单一传感器在管道气体泄漏检测时容易出现误报、漏报的问题,及时预警并反馈泄漏状况,提出一种基于交叉注意力的多源数据融合管道泄漏检测方法。首先,利用预训练的ShuffleNetV2模型提取热像仪数据的空间特征;然后,结合一维卷积神经网络(1DCNN)和双向门控循环单元(BiGRU),构建1DCNN-BiGRU模型,以提取气体传感器数据的时序特征;最后,运用交叉注意力捕获数据的时空关联性得到2个数据源的特征表示,通过残差方式进行特征连接后输入到分类层中,得到识别结果。结果表明:所构建的多源数据融合模型(SCGA)对气体识别准确率为99.22%,损失值在0~0.04内波动;与仅使用气体传感器数据的支持向量机(SVM)、1DCNN、BiGRU模型相比,准确率至少提升4.12%;与仅使用热图像传感器数据的MobileNetV3、ShuffleNetV2、ResNet18模型相比,准确率至少提升1.14%;与将时序特征和空间特征直接拼接的多源数据融合模型(SCG)相比,准确率提升1%。SCGA模型对气体识别具有较高精度。

, correspAuthors=null, authorNote=null, correspAuthorsNote=null, copyrightStatement=null, copyrightOwner=null, extLink=null, articleAbsUrl=null, sourceXml=LpwHg17GiSbeGuB16EXrNQ==, magXml=U/lgW7rttFZvqLCK80GNOA==, pdfUrl=null, pdf=LuQLGcGXUK7GwBTryIm0qw==, pdfFileSize=null, pdfExtLink=null, richHtmlUrl=null, mobilePdfUrl=null, reviewReport=null, pdfFirstPage=null, abstractGraph=null, abstractGraphContent=null, abstractVideo=null, citation=null, cebUrl=null, magXmlContent=EymEj1Viu9LkYcbwdj2/Jw==, mapNumber=null, authorCompany=null, fund=null, authors=

王新颖 (1976—),女,黑龙江海伦人,硕士,副教授,主要从事安全检测方面的研究。E-mail:

, authorsList=王新颖, 杨阳, 田豪杰, 陈俨, 张敏)}, authors=[Author(id=1168186560122991255, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, orderNo=0, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=wangxy@cczu.edu.cn, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1168186560223654554, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, authorId=1168186560122991255, language=EN, stringName=Xinying WANG, firstName=Xinying, middleName=null, lastName=WANG, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, 2, address=1 School of Safety Science and Engineering,Changzhou University,Changzhou Jiangsu 213164,China
2 Institute of Traffic Safety,China Academy of Safety Science and Technology,Beijing 100012,China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1168186560307540635, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, authorId=1168186560122991255, language=CN, stringName=王新颖, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, 2, address=1 常州大学 安全科学与工程学院,江苏 常州 213164
2 中国安全生产科学研究院 交通安全研究所,北京 100012, bio={"img":"JiKEWOMiB9II7RGvFWTyjA==","content":"

王新颖 (1976—),女,黑龙江海伦人,硕士,副教授,主要从事安全检测方面的研究。E-mail:

"}, bioImg=JiKEWOMiB9II7RGvFWTyjA==, bioContent=

王新颖 (1976—),女,黑龙江海伦人,硕士,副教授,主要从事安全检测方面的研究。E-mail:

, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1168186559862944397, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, xref=1, ext=[AuthorCompanyExt(id=1168186559867138702, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, companyId=1168186559862944397, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1 School of Safety Science and Engineering,Changzhou University,Changzhou Jiangsu 213164,China), AuthorCompanyExt(id=1168186559871333007, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, companyId=1168186559862944397, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1 常州大学 安全科学与工程学院,江苏 常州 213164)]), AuthorCompany(id=1168186559921664656, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, xref=2, ext=[AuthorCompanyExt(id=1168186559925858961, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, companyId=1168186559921664656, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2 Institute of Traffic Safety,China Academy of Safety Science and Technology,Beijing 100012,China), AuthorCompanyExt(id=1168186559934247570, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, companyId=1168186559921664656, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2 中国安全生产科学研究院 交通安全研究所,北京 100012)])]), Author(id=1168186560383038109, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, orderNo=1, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1168186560479507103, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, authorId=1168186560383038109, language=EN, stringName=Yang YANG, firstName=Yang, middleName=null, lastName=YANG, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, address=1 School of Safety Science and Engineering,Changzhou University,Changzhou Jiangsu 213164,China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1168186560550810272, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, authorId=1168186560383038109, language=CN, stringName=杨阳, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, address=1 常州大学 安全科学与工程学院,江苏 常州 213164, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1168186559862944397, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, xref=1, ext=[AuthorCompanyExt(id=1168186559867138702, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, companyId=1168186559862944397, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1 School of Safety Science and Engineering,Changzhou University,Changzhou Jiangsu 213164,China), AuthorCompanyExt(id=1168186559871333007, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, companyId=1168186559862944397, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1 常州大学 安全科学与工程学院,江苏 常州 213164)])]), Author(id=1168186560664056482, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, orderNo=2, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1168186560819245732, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, authorId=1168186560664056482, language=EN, stringName=Haojie TIAN, firstName=Haojie, middleName=null, lastName=TIAN, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, address=1 School of Safety Science and Engineering,Changzhou University,Changzhou Jiangsu 213164,China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1168186560919909029, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, authorId=1168186560664056482, language=CN, stringName=田豪杰, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, address=1 常州大学 安全科学与工程学院,江苏 常州 213164, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1168186559862944397, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, xref=1, ext=[AuthorCompanyExt(id=1168186559867138702, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, companyId=1168186559862944397, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1 School of Safety Science and Engineering,Changzhou University,Changzhou Jiangsu 213164,China), AuthorCompanyExt(id=1168186559871333007, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, companyId=1168186559862944397, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1 常州大学 安全科学与工程学院,江苏 常州 213164)])]), Author(id=1168186560978629287, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, orderNo=3, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1168186561083486889, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, authorId=1168186560978629287, language=EN, stringName=Yan CHEN, firstName=Yan, middleName=null, lastName=CHEN, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, address=1 School of Safety Science and Engineering,Changzhou University,Changzhou Jiangsu 213164,China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1168186561351922346, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, authorId=1168186560978629287, language=CN, stringName=陈俨, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, address=1 常州大学 安全科学与工程学院,江苏 常州 213164, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1168186559862944397, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, xref=1, ext=[AuthorCompanyExt(id=1168186559867138702, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, companyId=1168186559862944397, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1 School of Safety Science and Engineering,Changzhou University,Changzhou Jiangsu 213164,China), AuthorCompanyExt(id=1168186559871333007, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, companyId=1168186559862944397, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1 常州大学 安全科学与工程学院,江苏 常州 213164)])]), Author(id=1168186561481945772, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, orderNo=4, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1168186561624552110, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, authorId=1168186561481945772, language=EN, stringName=Min ZHANG, firstName=Min, middleName=null, lastName=ZHANG, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=3, address=3 Taizhou Oil Production Plant of East China Oil and Gas Branch,China Petroleum and Chemical Corporation,Taizhou Jiangsu 225300,China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1168186561767158447, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, authorId=1168186561481945772, language=CN, stringName=张敏, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=3, address=3 中国石油化工股份有限公司 华东油气分公司泰州采油厂,江苏 泰州 225300, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1168186560001356435, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, xref=3, ext=[AuthorCompanyExt(id=1168186560009745044, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, companyId=1168186560001356435, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=3 Taizhou Oil Production Plant of East China Oil and Gas Branch,China Petroleum and Chemical Corporation,Taizhou Jiangsu 225300,China), AuthorCompanyExt(id=1168186560018133653, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, companyId=1168186560001356435, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=3 中国石油化工股份有限公司 华东油气分公司泰州采油厂,江苏 泰州 225300)])])], keywords=[Keyword(id=1168186561968485040, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, language=EN, orderNo=1, keyword=cross-attention), Keyword(id=1168186562043982513, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, language=EN, orderNo=2, keyword=multi source data fusion), Keyword(id=1168186562123674290, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, language=EN, orderNo=3, keyword=gas leak detection), Keyword(id=1168186562178200243, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, language=EN, orderNo=4, keyword=convolutional neural network (CNN)), Keyword(id=1168186562241114804, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, language=EN, orderNo=5, keyword=bidirectional gated recurrent unit (BiGRU)), Keyword(id=1168186562312417973, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, language=CN, orderNo=1, keyword=交叉注意力), Keyword(id=1168186562358555318, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, language=CN, orderNo=2, keyword=多源数据融合), Keyword(id=1168186562438247095, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, language=CN, orderNo=3, keyword=气体泄漏检测), Keyword(id=1168186562501161656, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, language=CN, orderNo=4, keyword=卷积神经网络(CNN)), Keyword(id=1168186562555687609, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, language=CN, orderNo=5, keyword=双向门控循环单元(BiGRU))], refs=[Reference(id=1168186564506038987, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, doi=null, pmid=null, pmcid=null, year=null, volume=null, issue=null, pageStart=null, pageEnd=null, url=http://www.gov.cn/xinwen/2021-03/13/content_5592681.htm, language=null, rfNumber=[1], rfOrder=0, authorNames=null, journalName=null, refType=null, unstructuredReference=中华人民共和国中央人民政府. 中华人民共和国国民经济和社会发展第十四个五年规划和2035年远景目标纲要[EB/OL]. (2021-03-13). http://www.gov.cn/xinwen/2021-03/13/content_5592681.htm., articleTitle=中华人民共和国国民经济和社会发展第十四个五年规划和2035年远景目标纲要, refAbstract=null), Reference(id=1168186564573147852, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, doi=null, pmid=null, pmcid=null, year=2023, volume=33, issue=12, pageStart=140, pageEnd=147, url=null, language=null, rfNumber=[2], rfOrder=1, authorNames=向鹏成, 张子薇, 李卉, journalName=中国安全科学学报, refType=null, unstructuredReference=向鹏成, 张子薇, 李卉, 等. 城市地下燃气管道泄漏事故致因因素系统分析[J]. 中国安全科学学报, 2023, 33(12):140-147., articleTitle=城市地下燃气管道泄漏事故致因因素系统分析, refAbstract=null), Reference(id=1168186564644451021, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, doi=null, pmid=null, pmcid=null, year=2023, volume=33, issue=12, pageStart=140, pageEnd=147, url=null, language=null, rfNumber=[2], rfOrder=2, authorNames=XIANG Pengcheng, ZHANG Ziwei, LI Hui, journalName=China Safety Science Journal, refType=null, unstructuredReference=XIANG Pengcheng, ZHANG Ziwei, LI Hui, et al. Systematic analysis on causative factors for gas pipeline leakage accidents in urban underground[J]. China Safety Science Journal, 2023, 33(12):140-147., articleTitle=Systematic analysis on causative factors for gas pipeline leakage accidents in urban underground, refAbstract=null), Reference(id=1168186564761891534, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, doi=null, pmid=null, pmcid=null, year=2022, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=[3], rfOrder=3, authorNames=ATTALLAH O, MORISI I, journalName=Measurement, refType=null, unstructuredReference=ATTALLAH O, MORISI I. An electronic nose for identifying multiple combustible/harmful gases and their concentration levels via artificial intelligence[J]. Measurement, 2022,199:DOI:10.1016/j.measurement.2022.111458., articleTitle=An electronic nose for identifying multiple combustible/harmful gases and their concentration levels via artificial intelligence, refAbstract=null), Reference(id=1168186564833194703, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, doi=null, pmid=null, pmcid=null, year=2023, volume=null, issue=11, pageStart=1, pageEnd=6, url=null, language=null, rfNumber=[4], rfOrder=4, authorNames=李龙, 应滨州, 李华曜, journalName=仪表技术与传感器, refType=null, unstructuredReference=李龙, 应滨州, 李华曜, 等. 电子鼻多组分气体检测算法与性能研究[J]. 仪表技术与传感器, 2023(11):1-6,11., articleTitle=电子鼻多组分气体检测算法与性能研究, refAbstract=null), Reference(id=1168186564891914960, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, doi=null, pmid=null, pmcid=null, year=2023, volume=null, issue=11, pageStart=1, pageEnd=6, url=null, language=null, rfNumber=[4], rfOrder=5, authorNames=LI Long, YING Binzhou, LI Huayao, journalName=Instrument Technique and Sensor, refType=null, unstructuredReference=LI Long, YING Binzhou, LI Huayao, et al. Algorithm and performance study of electronic nose for multi-component gas detection[J]. Instrument Technique and Sensor, 2023(11):1-6,11., articleTitle=Algorithm and performance study of electronic nose for multi-component gas detection, refAbstract=null), Reference(id=1168186564975801041, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, doi=null, pmid=null, pmcid=null, year=2021, volume=17, issue=12, pageStart=8122, pageEnd=8130, url=null, language=null, rfNumber=[5], rfOrder=6, authorNames=RAHMAN C A, ROGERS S, journalName=IEEE Transactions on Industrial Informatics, refType=null, unstructuredReference=RAHMAN C A, ROGERS S, et al. Tensor-based approach for liquefied natural gas leakage detection from surveillance thermal cameras: a feasibility study in rural areas[J]. IEEE Transactions on Industrial Informatics, 2021, 17(12): 8122-8130., articleTitle=Tensor-based approach for liquefied natural gas leakage detection from surveillance thermal cameras: a feasibility study in rural areas, refAbstract=null), Reference(id=1168186565055492818, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, doi=null, pmid=null, pmcid=null, year=2022, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=[6], rfOrder=7, authorNames=WANG Jingfan, JI Jingwei, RAVIKUMAR A P, journalName=Energy, refType=null, unstructuredReference=WANG Jingfan, JI Jingwei, RAVIKUMAR A P, et al. VideoGasNet: deep learning for natural gas methane leak classification using an infrared camera[J]. Energy, 2022, 238: DOI:10.1016/j.energy.2021.121516., articleTitle=VideoGasNet: deep learning for natural gas methane leak classification using an infrared camera, refAbstract=null), Reference(id=1168186565110018771, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, doi=null, pmid=null, pmcid=null, year=2021, volume=4, issue=1, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=[7], rfOrder=8, authorNames=NARKHEDE P, WALAMBE R, MANDAOKAR S, journalName=Applied System Innovation, refType=null, unstructuredReference=NARKHEDE P, WALAMBE R, MANDAOKAR S, et al. Gas detection and identification using multimodal artificial intelligence based sensor fusion[J]. Applied System Innovation, 2021, 4(1):DOI:10.3390/asi4010003., articleTitle=Gas detection and identification using multimodal artificial intelligence based sensor fusion, refAbstract=null), Reference(id=1168186565160350420, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, doi=null, pmid=null, pmcid=null, year=2023, volume=33, issue=2, pageStart=173, pageEnd=178, url=null, language=null, rfNumber=[8], rfOrder=9, authorNames=杨余, 杨鑫, 王英, journalName=中国安全科学学报, refType=null, unstructuredReference=杨余, 杨鑫, 王英, 等. 基于mini-1D-CNN模型的TE过程故障诊断[J]. 中国安全科学学报, 2023, 33(2):173-178., articleTitle=基于mini-1D-CNN模型的TE过程故障诊断, refAbstract=null), Reference(id=1168186565231653589, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, doi=null, pmid=null, pmcid=null, year=2023, volume=33, issue=2, pageStart=173, pageEnd=178, url=null, language=null, rfNumber=[8], rfOrder=10, authorNames=YANG Yu, YANG Xin, WANG Ying, journalName=China Safety Science Journal, refType=null, unstructuredReference=YANG Yu, YANG Xin, WANG Ying, et al. Fault diagnosis of TE process based on mini-1D-CNN model[J]. China Safety Science Journal, 2023, 33(2):173-178., articleTitle=Fault diagnosis of TE process based on mini-1D-CNN model, refAbstract=null), Reference(id=1168186565294568150, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, doi=null, pmid=null, pmcid=null, year=2023, volume=17, issue=6, pageStart=1285, pageEnd=1300, url=null, language=null, rfNumber=[9], rfOrder=11, authorNames=梁宏涛, 刘硕, 杜军威, journalName=计算机科学与探索, refType=null, unstructuredReference=梁宏涛, 刘硕, 杜军威, 等. 深度学习应用于时序预测研究综述[J]. 计算机科学与探索, 2023, 17(6):1285-1300., articleTitle=深度学习应用于时序预测研究综述, refAbstract=null), Reference(id=1168186565344899799, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, doi=null, pmid=null, pmcid=null, year=2023, volume=17, issue=6, pageStart=1285, pageEnd=1300, url=null, language=null, rfNumber=[9], rfOrder=12, authorNames=LIANG Hongtao, LIU Shuo, DU Junwei, journalName=Journal of Frontiers of Computer Science and Technology, refType=null, unstructuredReference=LIANG Hongtao, LIU Shuo, DU Junwei. et al. A review of the application of deep learning in time series prediction research[J]. Journal of Frontiers of Computer Science and Technology, 2023, 17(6):1285-1300., articleTitle=A review of the application of deep learning in time series prediction research, refAbstract=null), Reference(id=1168186565428785880, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, doi=null, pmid=null, pmcid=null, year=2021, volume=18, issue=6, pageStart=2527, pageEnd=2538, url=null, language=null, rfNumber=[10], rfOrder=13, authorNames=HAN Jin, journalName=Journal of Real-time Image Processing, refType=null, unstructuredReference=HAN Jin, YANG Yonghao. L-Net: lightweight and fast object detector-based ShuffleNetV2[J]. Journal of Real-time Image Processing, 2021, 18(6): 2527-2538., articleTitle=L-Net: lightweight and fast object detector-based ShuffleNetV2, refAbstract=null), Reference(id=1168186565508477657, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, doi=null, pmid=null, pmcid=null, year=2020, volume=29, issue=null, pageStart=7615, pageEnd=7628, url=null, language=null, rfNumber=[11], rfOrder=14, authorNames=JI Jundong, XU Cheng, ZHANG Xiaodan, journalName=IEEE Transactions on Image Processing, refType=null, unstructuredReference=JI Jundong, XU Cheng, ZHANG Xiaodan, et al. Spatio-temporal memory attention for image captioning[J]. IEEE Transactions on Image Processing, 2020, 29: 7615-7628., articleTitle=Spatio-temporal memory attention for image captioning, refAbstract=null), Reference(id=1168186565571392218, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, doi=null, pmid=null, pmcid=null, year=2023, volume=23, issue=24, pageStart=307, pageEnd=10, url=null, language=null, rfNumber=[12], rfOrder=15, authorNames=田宝柱, 徐文涛, 梁鹏, journalName=科学技术与工程, refType=null, unstructuredReference=田宝柱, 徐文涛, 梁鹏, 等. 基于多传感器融合的埋地输水管道泄漏声发射定位方法[J]. 科学技术与工程, 2023, 23(24):10307-10 316., articleTitle=基于多传感器融合的埋地输水管道泄漏声发射定位方法, refAbstract=null), Reference(id=1168186565638501083, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, doi=null, pmid=null, pmcid=null, year=2023, volume=23, issue=24, pageStart=307, pageEnd=10, url=null, language=null, rfNumber=[12], rfOrder=16, authorNames=TIAN Baozhu, XU Wentao, LIANG Peng, journalName=Science Technology and Engineering, refType=null, unstructuredReference=TIAN Baozhu, XU Wentao, LIANG Peng, et al. Acoustic emission localization method of water pipeline based on multi-sensor fusion[J]. Science Technology and Engineering, 2023, 23(24):10307-10 316., articleTitle=Acoustic emission localization method of water pipeline based on multi-sensor fusion, refAbstract=null), Reference(id=1168186565713998556, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, doi=null, pmid=null, pmcid=null, year=2024, volume=34, issue=2, pageStart=37, pageEnd=44, url=null, language=null, rfNumber=[13], rfOrder=17, authorNames=王欣, 干镞锐, 许雅玺, journalName=中国安全科学学报, refType=null, unstructuredReference=王欣, 干镞锐, 许雅玺, 等. 基于字词向量融合的民航智慧监管短文本分类[J]. 中国安全科学学报, 2024, 34(2):37-44., articleTitle=基于字词向量融合的民航智慧监管短文本分类, refAbstract=null), Reference(id=1168186565768524509, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, doi=null, pmid=null, pmcid=null, year=2024, volume=34, issue=2, pageStart=37, pageEnd=44, url=null, language=null, rfNumber=[13], rfOrder=18, authorNames=WANG Xin, GAN Zurui, XU Yaxi, journalName=China Safety Science Journal, refType=null, unstructuredReference=WANG Xin, GAN Zurui, XU Yaxi, et al. Short text classification of civil aviation intelligent supervision based on character-word fusion[J]. China Safety Science Journal, 2024, 34(2):37-44., articleTitle=Short text classification of civil aviation intelligent supervision based on character-word fusion, refAbstract=null), Reference(id=1168186565814661854, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, doi=null, pmid=null, pmcid=null, year=2022, volume=48, issue=10, pageStart=45, pageEnd=54, url=null, language=null, rfNumber=[14], rfOrder=19, authorNames=赵宏, 郭岚, 陈志文, journalName=计算机工程, refType=null, unstructuredReference=赵宏, 郭岚, 陈志文, 等. 基于多模态融合与多层注意力的视频内容文本表述研究[J]. 计算机工程, 2022, 48(10):45-54., articleTitle=基于多模态融合与多层注意力的视频内容文本表述研究, refAbstract=null), Reference(id=1168186565894353631, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, doi=null, pmid=null, pmcid=null, year=2022, volume=48, issue=10, pageStart=45, pageEnd=54, url=null, language=null, rfNumber=[14], rfOrder=20, authorNames=ZHAO Hong, GUO Lan, CHEN Zhiwen, journalName=Computer Engineering, refType=null, unstructuredReference=ZHAO Hong, GUO Lan, CHEN Zhiwen, et al. Research on video content text representation based on multimodal fusion and multilayer attention[J]. Computer Engineering, 2022, 48(10):45-54., articleTitle=Research on video content text representation based on multimodal fusion and multilayer attention, refAbstract=null), Reference(id=1168186565990822624, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, doi=null, pmid=null, pmcid=null, year=2022, volume=7, issue=8, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=[15], rfOrder=21, authorNames=NARKHEDE P, WALAMBE R, CHANDEL P, journalName=Data, refType=null, unstructuredReference=NARKHEDE P, WALAMBE R, CHANDEL P, et al. MultimodalGasData: multimodal dataset for gas detection and classification[J]. Data, 2022, 7(8):DOI:10.3390/data7080112., articleTitle=MultimodalGasData: multimodal dataset for gas detection and classification, refAbstract=null), Reference(id=1168186566041154273, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, doi=null, pmid=null, pmcid=null, year=2022, volume=32, issue=9, pageStart=152, pageEnd=157, url=null, language=null, rfNumber=[16], rfOrder=22, authorNames=朱馨, 李建微, 郭伟, journalName=中国安全科学学报, refType=null, unstructuredReference=朱馨, 李建微, 郭伟, 等. 基于机器学习的森林火险预测模型[J]. 中国安全科学学报, 2022, 32(9):152-157., articleTitle=基于机器学习的森林火险预测模型, refAbstract=null), Reference(id=1168186566112457442, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, doi=null, pmid=null, pmcid=null, year=2022, volume=32, issue=9, pageStart=152, pageEnd=157, url=null, language=null, rfNumber=[16], rfOrder=23, authorNames=ZHU Xin, LI Jianwei, GUO Wei, journalName=China Safety Science Journal, refType=null, unstructuredReference=ZHU Xin, LI Jianwei, GUO Wei, et al. Forest fire risk prediction model based on machine learning[J]. China Safety Science Journal, 2022, 32(9):152-157., articleTitle=Forest fire risk prediction model based on machine learning, refAbstract=null), Reference(id=1168186566183760611, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, doi=null, pmid=null, pmcid=null, year=2023, volume=46, issue=14, pageStart=182, pageEnd=187, url=null, language=null, rfNumber=[17], rfOrder=24, authorNames=梁秀满, 安金铭, 曹晓华, journalName=电子测量技术, refType=null, unstructuredReference=梁秀满, 安金铭, 曹晓华, 等. 基于改进MobileNetV3烧结断面火焰图像识别[J]. 电子测量技术, 2023, 46(14):182-187., articleTitle=基于改进MobileNetV3烧结断面火焰图像识别, refAbstract=null), Reference(id=1168186566263452388, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, doi=null, pmid=null, pmcid=null, year=2023, volume=46, issue=14, pageStart=182, pageEnd=187, url=null, language=null, rfNumber=[17], rfOrder=25, authorNames=LIANG Xiuman, AN Jinming, CAO Xiaohua, journalName=Electronic Measurement Technology, refType=null, unstructuredReference=LIANG Xiuman, AN Jinming, CAO Xiaohua, et al. Flame image recognition of sintering section based on improve MobileNetV3[J]. Electronic Measurement Technology, 2023, 46(14):182-187., articleTitle=Flame image recognition of sintering section based on improve MobileNetV3, refAbstract=null), Reference(id=1168186566317978341, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, doi=null, pmid=null, pmcid=null, year=2022, volume=41, issue=3, pageStart=154, pageEnd=164, url=null, language=null, rfNumber=[18], rfOrder=26, authorNames=刘飞, 陈仁文, 邢凯玲, journalName=振动与冲击, refType=null, unstructuredReference=刘飞, 陈仁文, 邢凯玲, 等. 基于迁移学习与深度残差网络的滚动轴承快速故障诊断算法[J]. 振动与冲击, 2022, 41(3):154-164., articleTitle=基于迁移学习与深度残差网络的滚动轴承快速故障诊断算法, refAbstract=null), Reference(id=1168186566410253030, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, doi=null, pmid=null, pmcid=null, year=2022, volume=41, issue=3, pageStart=154, pageEnd=164, url=null, language=null, rfNumber=[18], rfOrder=27, authorNames=LIU Fei, CHEN Renwen, XING Kailing, journalName=Journal of Vibration and Shock, refType=null, unstructuredReference=LIU Fei, CHEN Renwen, XING Kailing, et al. Fast fault diagnosis algorithm for rolling bearing based on transfer learning and deep residual networks[J]. Journal of Vibration and Shock, 2022, 41(3):154-164., articleTitle=Fast fault diagnosis algorithm for rolling bearing based on transfer learning and deep residual networks, refAbstract=null), Reference(id=1168186566523499239, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, doi=null, pmid=null, pmcid=null, year=2023, volume=27, issue=7, pageStart=4139, pageEnd=4155, url=null, language=null, rfNumber=[19], rfOrder=28, authorNames=RAHATE A, MANDAOKAR S, CHANDEL P, journalName=Soft Computing, refType=null, unstructuredReference=RAHATE A, MANDAOKAR S, CHANDEL P, et al. Employing multimodal co-learning to evaluate the robustness of sensor fusion for industry 5.0 tasks[J]. Soft Computing, 2023, 27(7): 4139-4155., articleTitle=Employing multimodal co-learning to evaluate the robustness of sensor fusion for industry 5.0 tasks, refAbstract=null), Reference(id=1168186566628356840, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, doi=null, pmid=null, pmcid=null, year=2023, volume=11, issue=7, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=[20], rfOrder=29, authorNames=ATTALLAH O, journalName=Chemosensors, refType=null, unstructuredReference=ATTALLAH O. Multitask deep learning-based pipeline for gas leakage detection via E-nose and thermal imaging multimodal fusion[J]. Chemosensors, 2023, 11(7):DOI:10.3390/chemosensors11070364., articleTitle=Multitask deep learning-based pipeline for gas leakage detection via E-nose and thermal imaging multimodal fusion, refAbstract=null)], funds=[Fund(id=1168186564338266826, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, awardId=CZ20210026, language=CN, fundingSource=常州市国际科技合作项目(CZ20210026), fundOrder=null, country=null)], companyList=[AuthorCompany(id=1168186559862944397, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, xref=1, ext=[AuthorCompanyExt(id=1168186559867138702, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, companyId=1168186559862944397, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1 School of Safety Science and Engineering,Changzhou University,Changzhou Jiangsu 213164,China), AuthorCompanyExt(id=1168186559871333007, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, companyId=1168186559862944397, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1 常州大学 安全科学与工程学院,江苏 常州 213164)]), AuthorCompany(id=1168186559921664656, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, xref=2, ext=[AuthorCompanyExt(id=1168186559925858961, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, companyId=1168186559921664656, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2 Institute of Traffic Safety,China Academy of Safety Science and Technology,Beijing 100012,China), AuthorCompanyExt(id=1168186559934247570, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, companyId=1168186559921664656, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2 中国安全生产科学研究院 交通安全研究所,北京 100012)]), AuthorCompany(id=1168186560001356435, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, xref=3, ext=[AuthorCompanyExt(id=1168186560009745044, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, companyId=1168186560001356435, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=3 Taizhou Oil Production Plant of East China Oil and Gas Branch,China Petroleum and Chemical Corporation,Taizhou Jiangsu 225300,China), AuthorCompanyExt(id=1168186560018133653, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, companyId=1168186560001356435, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=3 中国石油化工股份有限公司 华东油气分公司泰州采油厂,江苏 泰州 225300)])], figs=[ArticleFig(id=1168186562757014202, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, language=EN, label=Fig.1, caption=Multi source data fusion model, figureFileSmall=UDIHxJKU+VtMcjeNxXd+xg==, figureFileBig=ME4JMFVrpm4j28PVVPUR8w==, tableContent=null), ArticleFig(id=1168186562811540155, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, language=CN, label=图1, caption=多源数据融合模型, figureFileSmall=UDIHxJKU+VtMcjeNxXd+xg==, figureFileBig=ME4JMFVrpm4j28PVVPUR8w==, tableContent=null), ArticleFig(id=1168186562878649020, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, language=EN, label=Fig.2, caption=Cross attention mechanism, figureFileSmall=yqbXkuWJLwRBan3bORLG7Q==, figureFileBig=WJbsjgW39Mn1TS8be3dgQg==, tableContent=null), ArticleFig(id=1168186562945757885, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, language=CN, label=图2, caption=交叉注意力机制, figureFileSmall=yqbXkuWJLwRBan3bORLG7Q==, figureFileBig=WJbsjgW39Mn1TS8be3dgQg==, tableContent=null), ArticleFig(id=1168186562991895230, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, language=EN, label=Fig.3, caption=Accuracy and loss function variation curve, figureFileSmall=Dnl09VLB56Fgt8S4F18Hcw==, figureFileBig=zBTSmKOcm6ZKVTrn+3a7Vg==, tableContent=null), ArticleFig(id=1168186563105141439, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, language=CN, label=图3, caption=准确率和损失函数变化曲线, figureFileSmall=Dnl09VLB56Fgt8S4F18Hcw==, figureFileBig=zBTSmKOcm6ZKVTrn+3a7Vg==, tableContent=null), ArticleFig(id=1168186563163861696, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, language=EN, label=Fig.4, caption=Model indicator evaluation value, figureFileSmall=o+zU1oUc0YAnzZHVFiFytw==, figureFileBig=oD2ysNdsEIcxydkDl9FSyQ==, tableContent=null), ArticleFig(id=1168186563226776257, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, language=CN, label=图4, caption=模型指标评价值, figureFileSmall=o+zU1oUc0YAnzZHVFiFytw==, figureFileBig=oD2ysNdsEIcxydkDl9FSyQ==, tableContent=null), ArticleFig(id=1168186563306468034, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, language=EN, label=Fig.5, caption=Evaluation index values of different dimensions, figureFileSmall=IuYMJPaM7G0IJXCUDaulMA==, figureFileBig=StiHLZbJjAnv79hX6nllhw==, tableContent=null), ArticleFig(id=1168186563398742723, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, language=CN, label=图5, caption=不同维度的评价指标值, figureFileSmall=IuYMJPaM7G0IJXCUDaulMA==, figureFileBig=StiHLZbJjAnv79hX6nllhw==, tableContent=null), ArticleFig(id=1168186563549737668, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, language=EN, label=Table 1, caption=

Model parameter settings

, figureFileSmall=null, figureFileBig=null, tableContent=
模型 参数 取值
CNN CNN-1出入通道
CNN-2出入通道
卷积核
填充
[1,16]
[16,32]
2
1
池化层 卷积核
填充
2
1
BiGRU 输入通道
隐藏维度
32
64
交叉注意力 头数量
融合特征维度
4
128
网络训练 学习率
批次大小
优化器
迭代次数
损失函数
0.001
32
Adam
50
Cross Entropy Loss
), ArticleFig(id=1168186563658789573, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, language=CN, label=表1, caption=

模型参数设置

, figureFileSmall=null, figureFileBig=null, tableContent=
模型 参数 取值
CNN CNN-1出入通道
CNN-2出入通道
卷积核
填充
[1,16]
[16,32]
2
1
池化层 卷积核
填充
2
1
BiGRU 输入通道
隐藏维度
32
64
交叉注意力 头数量
融合特征维度
4
128
网络训练 学习率
批次大小
优化器
迭代次数
损失函数
0.001
32
Adam
50
Cross Entropy Loss
), ArticleFig(id=1168186563767841478, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, language=EN, label=Table 2, caption=

Comparison of model accuracy

, figureFileSmall=null, figureFileBig=null, tableContent=
文章 方法 准确率/%
文献[7] CNN+LSTM
早期融合
96.0
文献[19] CNN+LSTM
中期融合
94.5
文献[19] CNN+LSTM
多任务融合
96.9
文献[20] Inception+DWT+
BiLSTM
中期融合
98.5
文献[20] (ResNet50+Inception+
MobileNet)+DWT+
DCT+BiLSTM
多任务融合
99.2
本文 ShuffleNet+
(CNN-BiGRU)+CA
99.2
), ArticleFig(id=1168186563855921863, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, language=CN, label=表2, caption=

模型准确率对比

, figureFileSmall=null, figureFileBig=null, tableContent=
文章 方法 准确率/%
文献[7] CNN+LSTM
早期融合
96.0
文献[19] CNN+LSTM
中期融合
94.5
文献[19] CNN+LSTM
多任务融合
96.9
文献[20] Inception+DWT+
BiLSTM
中期融合
98.5
文献[20] (ResNet50+Inception+
MobileNet)+DWT+
DCT+BiLSTM
多任务融合
99.2
本文 ShuffleNet+
(CNN-BiGRU)+CA
99.2
), ArticleFig(id=1168186563998528200, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, language=EN, label=Table 3, caption=

Model parameter quantity

, figureFileSmall=null, figureFileBig=null, tableContent=
模型 参数数量
CNN 2 004
BiGRU 28 548
SVM 1 225
CNN-BiGRU 112 980
MobileNetV3 471 668
ShuffleNetV2 345 892
ResNet18 11 178 564
SCG 528 756
SCGA 579 060
), ArticleFig(id=1168186564128551625, tenantId=1146029695717560320, journalId=1146031787341344770, articleId=1149738776303415546, language=CN, label=表3, caption=

模型参数量

, figureFileSmall=null, figureFileBig=null, tableContent=
模型 参数数量
CNN 2 004
BiGRU 28 548
SVM 1 225
CNN-BiGRU 112 980
MobileNetV3 471 668
ShuffleNetV2 345 892
ResNet18 11 178 564
SCG 528 756
SCGA 579 060
)], attaches=null, journal=Journal(id=1123942128916217864, delFlag=0, nameCn=中国安全科学学报, nameEn=China Safety Science Journal, nameHistory1=null, nameHistory2=null, issn=1003-3033, eissn=, cn=11-2865/X, coden=null, periodic=0, language=CN, oaType=0, ccby=null, superviseOffice=null, ownerOffice=null, pubOffice=null, editorOffice=null, officeType=null, aims=null, clcCode=null, officeProv=null, officeCity=null, officeAddr=null, officeZip=null, officeEmail=null, officePhone=null, editDirector=null, officeDirector=null, officeDirectorPhone=null, officeStaffNum=null, officeEmpNum=null, coverPicUrl=fkqsFM6VKlHC4gCtS5XqTw==, journalPrice=null, startedYear=null, abbrevIsoEn=Chin Saf Sci J, journalRemark=null, publicationField=null, createdTime=null, updatedTime=1754269350027, createdBy=null, updatedBy=13701087609, firstLetterCn=C, firstLetterEn=C, subjectCode=Engineering, subjectName=工程, subjectCodeEn=Engineering, subjectNameEn=null, picCn=fkqsFM6VKlHC4gCtS5XqTw==, picEn=SHn9HgqSxtJrOcAxqD++4Q==, jcr=null, cjcr=null, exts=[JournalExt(id=1159052918994595848, language=CN, name=中国安全科学学报, nameHistory1=null, nameHistory2=null, managedBy=, sponsoredBy=, publishedBy=, editorOffice=, officeProv=null, officeCity=null, officeAddr=, officeZip=, editDirector=null, officeDirector=null, officePhone=null, coverPicUrl=null, journalRemark=, submitArticleUrl=null, websiteUrl=http://www.cssjj.com.cn/, createdTime=1754269350050, updatedTime=1754269350050, createdBy=13701087609, updatedBy=13701087609, submissionGuidelinesUrl=http://www.cssjj.com.cn/CN/column/item15.shtml, submissionAuthorUrl=https://zgaqkxxbauthor.manuscriptcloud.com/login, submissionEditorUrl=https://zgaqkxxbeditor.manuscriptcloud.com/login, submissionReviewUrl=https://zgaqkxxbauthor.manuscriptcloud.com/login, submissionCeEditorUrl=https://zgaqkxxbeditor.manuscriptcloud.com/login, submissionAeEditorUrl=https://zgaqkxxbeditor.manuscriptcloud.com/login, option={"copyright":""}), JournalExt(id=1159052919040733193, language=EN, name=China Safety Science Journal, nameHistory1=null, nameHistory2=null, managedBy=, sponsoredBy=, publishedBy=, editorOffice=, officeProv=null, officeCity=null, officeAddr=, officeZip=, editDirector=null, officeDirector=null, officePhone=null, coverPicUrl=null, journalRemark=, submitArticleUrl=null, websiteUrl=http://www.cssjj.com.cn/EN/1003-3033/home.shtml, createdTime=1754269350061, updatedTime=1754269350061, createdBy=13701087609, updatedBy=13701087609, submissionGuidelinesUrl=https://synbioj.cip.com.cn/EN/column/column3.shtml, submissionAuthorUrl=https://zgaqkxxbauthor.manuscriptcloud.com/login, submissionEditorUrl=https://zgaqkxxbeditor.manuscriptcloud.com/login, submissionReviewUrl=https://zgaqkxxbauthor.manuscriptcloud.com/login, submissionCeEditorUrl=https://zgaqkxxbeditor.manuscriptcloud.com/login, submissionAeEditorUrl=https://zgaqkxxbeditor.manuscriptcloud.com/login, option={"copyright":""})], databaseList=null, tenantJournalId=1146031787341344770, websiteList=[Website(id=1148243202345263519, webName=null, webTitle=null, webDomain=null, webCopyrigh=null, webIpcNo=null, seoTitle=null, seoKeywords=null, seoDescription=null, tenantJournalId=null, journalId=1146031787341344770, journalNameCn=null, journalNameEn=null, grayFlag=null, tenantId=1146029695717560320, platformId=null, journalGroupId=null, journalGroupNameCn=null, journalGroupNameEn=null, type=1, domain=https://castjournals.cast.org.cn/joweb/zgaqkxxb/CN, language=CN, createTime=1751692112766, createBy=18614031015, updateTime=1753502583634, updateBy=18614031015, name=《中国安全科学学报》中文站点, tplId=1146099689490845704, title=中国安全科学学报, delFlag=0, indexPage=/home, props=[WebsiteProps(id=1148618794941046792, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1148243202345263519, code=articleTextType, value=kx, createTime=1751781661020, updateTime=1751781661020, creator=18614031015, updator=18614031015), WebsiteProps(id=1148618794911686661, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1148243202345263519, code=banner, value=null, createTime=1751781661012, updateTime=1751781661012, creator=18614031015, updator=18614031015), WebsiteProps(id=1148618794894909444, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1148243202345263519, code=logo, value=https://castjournals.cast.org.cn/joweb/kjdb/CN/file/pic?fileId=tui0IVO9FMwB61HHtX5scg==, createTime=1751781661008, updateTime=1751781661008, creator=18614031015, updator=18614031015), WebsiteProps(id=1148618794932658183, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1148243202345263519, code=picServerUrl, value=https://castjournals.cast.org.cn/joweb/kjdb/CN/file/pic, createTime=1751781661017, updateTime=1751781661017, creator=18614031015, updator=18614031015), WebsiteProps(id=1148618794924269574, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1148243202345263519, code=staticResourcePath, value=https://castjournals.cast.org.cn/joweb/cast_kjdb_cn_619/, createTime=1751781661015, updateTime=1751781661015, creator=18614031015, updator=18614031015)]), Website(id=1155836763751993353, webName=null, webTitle=null, webDomain=null, webCopyrigh=null, webIpcNo=null, seoTitle=null, seoKeywords=null, seoDescription=null, tenantJournalId=null, journalId=1146031787341344770, journalNameCn=null, journalNameEn=null, grayFlag=null, tenantId=1146029695717560320, platformId=null, journalGroupId=null, journalGroupNameCn=null, journalGroupNameEn=null, type=1, domain=https://castjournals.cast.org.cn/joweb/zgaqkxxb/EN, language=EN, createTime=1753502558893, createBy=18614031015, updateTime=1753524450387, updateBy=18614031015, name=《中国安全科学学报》英文站点, tplId=1146101810881728533, title=China Safety Science Journal, delFlag=0, indexPage=/home, props=[WebsiteProps(id=1155895925743669425, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1155836763751993353, code=articleTextType, value=kx, createTime=1753516664205, updateTime=1753516664205, creator=18614031015, updator=18614031015), WebsiteProps(id=1155895925722697902, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1155836763751993353, code=banner, value=null, createTime=1753516664200, updateTime=1753516664200, creator=18614031015, updator=18614031015), WebsiteProps(id=1155895925714309293, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1155836763751993353, code=logo, value=https://castjournals.cast.org.cn/joweb/kjdb/CN/file/pic?fileId=tui0IVO9FMwB61HHtX5scg==, createTime=1753516664198, updateTime=1753516664198, creator=18614031015, updator=18614031015), WebsiteProps(id=1155895925735280816, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1155836763751993353, code=picServerUrl, value=https://castjournals.cast.org.cn/joweb/kjdb/CN/file/pic, createTime=1753516664203, updateTime=1753516664203, creator=18614031015, updator=18614031015), WebsiteProps(id=1155895925731086511, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1155836763751993353, code=staticResourcePath, value=https://castjournals.cast.org.cn/joweb/cast_kjdb_cn_619/, createTime=1753516664202, updateTime=1753516664202, creator=18614031015, updator=18614031015)])], journalTitle=中国安全科学学报, weixinUrl=null, journalUrl=null, iacademicId=null, status=0, seqNo=null, journalTitleEn=China Safety Science Journal, journalPhotoCn=fkqsFM6VKlHC4gCtS5XqTw==, journalPhotoEn=SHn9HgqSxtJrOcAxqD++4Q==, journalFirstLetter=C, journalRecommend=null, journalNew=null, journalCollection=1, jcrJf=null, cjcrJf=null, jcrJfStr=null, cjcrJfStr=null, submissionFirstDecision=null, sciSubjectClassification=null, casSubjectClassification=null, citeScore=null, totalCitationFrequency=null, icpCode=null, psCode=null, advertisingLicenseCode=null, copyrightInformation=null, country=null, option=null, provinceCode=null, provinceName=null, collectFlag=false), detailUrlCn=https://castjournals.cast.org.cn/joweb/zgaqkxxb/CN/10.16265/j.cnki.issn1003-3033.2024.07.0135, detailUrlEn=https://castjournals.cast.org.cn/joweb/zgaqkxxb/EN/10.16265/j.cnki.issn1003-3033.2024.07.0135, pdfUrlCn=https://castjournals.cast.org.cn/joweb/zgaqkxxb/CN/PDF/10.16265/j.cnki.issn1003-3033.2024.07.0135, pdfUrlEn=https://castjournals.cast.org.cn/joweb/zgaqkxxb/EN/PDF/10.16265/j.cnki.issn1003-3033.2024.07.0135, aliStartDate=null, aliEndDate=null, collectionFlag=false, citedCount=null, citedUrl=null, reference=null)
收藏切换
基于交叉注意力的多源数据融合的气体泄漏检测
收藏切换
PDF下载
王新颖 1, 2 , 杨阳 1 , 田豪杰 1 , 陈俨 1 , 张敏 3
中国安全科学学报 | 安全工程技术 2024,34(7): 91-97
收起
收藏切换
中国安全科学学报 | 安全工程技术 2024, 34(7): 91-97
基于交叉注意力的多源数据融合的气体泄漏检测
全屏
王新颖1, 2 , 杨阳1, 田豪杰1, 陈俨1, 张敏3
作者信息
  • 1 常州大学 安全科学与工程学院,江苏 常州 213164
  • 2 中国安全生产科学研究院 交通安全研究所,北京 100012
  • 3 中国石油化工股份有限公司 华东油气分公司泰州采油厂,江苏 泰州 225300
  • 王新颖 (1976—),女,黑龙江海伦人,硕士,副教授,主要从事安全检测方面的研究。E-mail:

Gas leak detection based on cross-attention multi-source data fusion
Xinying WANG1, 2 , Yang YANG1, Haojie TIAN1, Yan CHEN1, Min ZHANG3
Affiliations
  • 1 School of Safety Science and Engineering,Changzhou University,Changzhou Jiangsu 213164,China
  • 2 Institute of Traffic Safety,China Academy of Safety Science and Technology,Beijing 100012,China
  • 3 Taizhou Oil Production Plant of East China Oil and Gas Branch,China Petroleum and Chemical Corporation,Taizhou Jiangsu 225300,China
出版时间: 2024-07-28 doi: 10.16265/j.cnki.issn1003-3033.2024.07.0135
文章导航
收藏切换

为解决单一传感器在管道气体泄漏检测时容易出现误报、漏报的问题,及时预警并反馈泄漏状况,提出一种基于交叉注意力的多源数据融合管道泄漏检测方法。首先,利用预训练的ShuffleNetV2模型提取热像仪数据的空间特征;然后,结合一维卷积神经网络(1DCNN)和双向门控循环单元(BiGRU),构建1DCNN-BiGRU模型,以提取气体传感器数据的时序特征;最后,运用交叉注意力捕获数据的时空关联性得到2个数据源的特征表示,通过残差方式进行特征连接后输入到分类层中,得到识别结果。结果表明:所构建的多源数据融合模型(SCGA)对气体识别准确率为99.22%,损失值在0~0.04内波动;与仅使用气体传感器数据的支持向量机(SVM)、1DCNN、BiGRU模型相比,准确率至少提升4.12%;与仅使用热图像传感器数据的MobileNetV3、ShuffleNetV2、ResNet18模型相比,准确率至少提升1.14%;与将时序特征和空间特征直接拼接的多源数据融合模型(SCG)相比,准确率提升1%。SCGA模型对气体识别具有较高精度。

交叉注意力  /  多源数据融合  /  气体泄漏检测  /  卷积神经网络(CNN)  /  双向门控循环单元(BiGRU)

In order to solve the problem of false alarms and missed alarms in pipeline gas leakage detection using a single sensor,timely warning and feedback of leakage status,a multi-source data fusion pipeline leakage detection method based on cross-attention was proposed. Firstly,the pre-trained ShuffleNetV2 model was used to extract spatial features from thermal imaging data. Then,a 1DCNN BiGRU model was constructed by combining a one-dimensional CNN (1DCNN) and a bidirectional gated recurrent unit (BiGRU) to extract temporal features from gas sensors. Finally,cross-attention was used to capture the spatiotemporal correlation of the data and obtain the feature representations of the two data sources. The residual method was used to connect the features and input them into the classification layer to obtain the recognition results. The results show that the constructed SCGA model has a gas recognition accuracy of 99.22%,and the loss value fluctuates between 0-0.04. Compared with support vector machines (SVM),1DCNN,and BiGRU models that only use gas sensor data,the accuracy is improved by at least 4.12%. Compared with MobileNetV3,ShuffleNetV2,and ResNet18 models that only use thermal image sensor data,the accuracy is improved by at least 1.14%. Compared with the multi-source data fusion model SCG,which simply connects temporal and spatial features,the accuracy is improved by 1%. It was verified that the SCGA model has high accuracy.

cross-attention  /  multi source data fusion  /  gas leak detection  /  convolutional neural network (CNN)  /  bidirectional gated recurrent unit (BiGRU)
王新颖, 杨阳, 田豪杰, 陈俨, 张敏. 基于交叉注意力的多源数据融合的气体泄漏检测. 中国安全科学学报, 2024 , 34 (7) : 91 -97 . DOI: 10.16265/j.cnki.issn1003-3033.2024.07.0135
Xinying WANG, Yang YANG, Haojie TIAN, Yan CHEN, Min ZHANG. Gas leak detection based on cross-attention multi-source data fusion[J]. China Safety Science Journal, 2024 , 34 (7) : 91 -97 . DOI: 10.16265/j.cnki.issn1003-3033.2024.07.0135
按照“十四五”规划,中国油气管网将全面实现物理互联互通,其规模会持续扩大[1]。随着管道长度和工厂结构复杂性的增加,腐蚀、挤压、裂纹等原因造成的管道泄漏更加频繁,有效检测管道的运行工况,及时发现泄漏,可维护人民生命健康和财产安全[2]
由气体检测传感器、信号处理模块和识别系统构成的电子鼻被广泛应用于气体泄漏检测,它对特定气体的检测灵敏度高,同时避免了人为干预。许多学者将深度学习和电子鼻技术结合提升气体泄漏检测准确性。ATTALLAH等[3]提出一种名为Gas Con-Enose的智能电子鼻系统,并验证了特征融合能够提高识别准确率。李龙等[4]提出一种基于线性判别式分析(Linear Discriminant Analysis,LDA)的电子鼻多组分气体检测算法,实现了对C2H6O、NO2和CH2O等气体的可靠检测,获得的定性和定量结果准确率分别高达100%和91%。当气体泄漏时,周围空间的温度会发生变化,这些变化可被高敏感度的热成像相机捕到,从而提供泄漏的早期警示。BIN Junchi等[5]提出一种基于张量的泄漏检测方法,通过热像仪检测农村地区的液化天然气泄漏,所提方法利用张量分解来融合热图像和相应的梯度图,提高了天然气检测的灵敏度。WANG Jingfan等[6]基于CH4泄漏的红外视频数据集,研究了二维卷积网络、三维卷积网络和卷积长短期记忆网络,结果显示,三维卷积网络在泄漏检测中的准确率接近100%,且泄漏量的分类准确率达78.2%。在近期研究中,部分学者采用气体传感器和热成像相机的组合技术来提高管道气体泄漏准确性,通过这种数据融合,在复杂或干扰性环境中,系统能够更加准确地识别泄漏。NARKHEDE等[7]通过数据层融合技术,将气体传感器数据与热像仪数据结合,构建的模型气体识别准确率达到96%,优于仅使用热像数据的卷积神经网络(Convolutional Neural Networks,CNN)模型(识别准确率为93%)和仅使用气体传感器数据的长短期记忆网络模型(识别准确率为82%)。但在复杂的工业环境中,多种气体混合以及低浓度泄漏的检测往往超出电子鼻的能力范围。虽然基于热成像的系统可以检测气体的存在,但它无法区分气体类型,而且可能会因为环境温度波动、设备热效应等因素而产生误报。此外,在采用数据融合技术的研究中,忽略了气体泄漏数据时间和空间上的相互关系,而使用机器学习方法分析数据时空关联性,可以更好地捕获到数据的特征,更准确地评估和预测风险。
鉴于此,笔者拟综合考虑管道泄漏数据的时空关联性,构建一种基于交叉注意力的多源数据融合模型(ShuffleNetV2-1DCNN-BiGRU-Attention,SCGA)。首先,使用ShuffleNetV2模型提取热像仪数据的空间特征;其次,将一维CNN(1D CNN,1DCNN)与双向门控循环单元(Bidirectional Gated Recurrent Unit,BiGRU)结合,构建1DCNN-BiGRU模型,提取气体传感器数据的时序特征;然后,将时序特征和空间特征运用交叉注意力机制融合后,输入至分类层识别;最后,为验证所提出模型的有效性,选取使用气体传感器数据、热像仪数据以及多源数据融合的3类基线模型对比,并探究各个模型的计算成本和交叉注意力的特征融合维度对模型性能的影响,以期开发先进稳定可靠的人工智能泄漏检测技术,实现气体泄漏检测的早发现和早控制,最大限度减少财产损失和人员生命伤亡。
1DCNN由卷积层、池化层和全连接层构成。卷积层是核心,包含多个卷积核在输入数据上滑动以提取特征,通常结合ReLU激活函数添加非线性特性。池化层降低特征尺寸以减少计算量和参数数量,同时保持特征的代表性。全连接层位于网络末端,用于整合特征并产生最终输出。与二维CNN处理图像不同,1DCNN在单个维度上滑动卷积核,特别适合分析时序数据[8]
门控循环单元(Gated Recurrent Unit,GRU)是一种改进的循环神经网络,其结构简单,参数少,计算效率更高。文中采用的是BiGRU,它由2个GRU组成,一个处理时间序列正向,另一个处理时间序列反向,可以更全面地理解整个序列[9]
ShuffleNetV2是一种高效的CNN架构,通过其独特的设计,如通道混洗和分组卷积,能够在保持高精度的同时减少计算量和参数量[10]
注意力机制模拟了人类在处理信息时的注意力分配,使模型能够在处理大量输入数据时,集中关注最重要的部分。文中采用的交叉注意力机制(Cross Attention,CA)涉及查询Q、键K和值V这 3个向量。对于序列中的每个元素,计算其查询与其他元素键的兼容性得分,用这些得分加权各元素的值。通过加权求和值向量,最终得到每个位置的输出,该输出包含整个序列的信息[11]
为弥补单一传感器数据的缺点,采用数据融合技术提高管道气体泄漏检测的准确性。多源数据融合从融合阶段考虑分为数据层、特征层和决策层融合[12]。数据层融合计算量大且耗时长,决策层融合数据损失多且精度低。因此,从特征融合出发,构建基于交叉注意力的SCGA,其总体框架如图1所示。SCGA的主要流程如下:①使用热像仪和气体传感器采集泄漏气体数据;②将预训练的ShuffleNetV2模型作为特征提取器,捕获热图像的空间特征,构建1DCNN-BiGRU模型提取气体传感器的时序特征;③使用交叉注意力机制对得到的空间特征和时序特征进行融合更新;④由交叉注意力机制处理的融合特征通过残差连接并输入到分类层进行识别。
所构建的模型输入为热像仪和气体传感器原始数据,无需预处理,最大程度保持了数据的完整性。使用预训练的ShuffleNetV2模型提取热图像的空间特征,可大幅减少训练时间和计算成本。为挖掘气体传感器的多特征关联性和时序依赖特征,选取CNN网络提取气体传感器数据的关键特征,利用BiGRU网络独特的门结构学习数据处理机制,组合构建1DCNN-BiGRU模型提取气体浓度随时间变化的动态特征。同时,提出一种基于交叉注意力的特征融合方法,通过建立热像仪数据和气体传感器数据之间的特征交互,提高多源数据信息的充分利用。
准确率(Accuracy,AC)表示所有预测中正确预测的比例,召回率(Recall,RC)表示实际为正类的样本中被正确预测为正类的比例,精确率(Precision,PR)表示被预测为正类的样本中实际为正类的比例,F1分数为精确率和召回率的调和平均数,马修斯相关系数(Matthews Coefficient,MCC)在类别分布不平衡时也能提供可靠的性能评估[13]。其计算公式如下:
A C = T P + T N T P + F P + T N + F N
R C = T P T P + F N
P R = T P T P + F P
F 1 = 2 × P R · R C P R + R C
M C C = T P · T N - F P · F N ( T P + F P ) ( T P + F N ) ( T N + F P ) ( T N + F N )
式中:TP(True Positive)为真阳性,表示准确预测出正类样本时的实例;FP(False Positive)为假阳性,表示错误判定为正类样本的实例;FN(False Negative)为假阴性,表示错误判定为负类样本的实例;TN为(True Negative)真阴性,表示准确预测负类样本的实例。
对于气体传感器数据,采用1DCNN-BiGRU模型提取时序特征,包括2层卷积层、2层池化层以及BiGRU层。第1层卷积层和池化层是为了提取数据中的关键特征;第2层卷积层和池化层将提取的特征放大;BiGRU层用以捕获特征的时序关系。模型输入的气体传感器数据集大小为6 400×7,输出为BiGRU层捕获的时序特征向量I
使用预训练的ShuffleNetV2模型提取热像仪收集的图像数据的空间特征,首先,将模型的缩放因子设置为0.5,每个卷积层的通道数都减少到原始模型的50%,从而减少模型的计算量和参数数量;然后,将输入图像的大小调为224×224×3以适应模型的输入;最后,将模型的全连接层移除,使网络输出空间特征向量C
为有效捕获数据的时空关联性,基于自注意力机制设计了交叉注意力融合机制,其结构如图2所示。其中,Q为查询,K为键,V为值。
将1DCNN-BiGRU模型捕获的时序特征I作为查询Q,将ShuffleNetV2捕获的空间特征C作为键K和值V。通过下式计算注意力分数[14]。其中,WQWK为可学习参数,dkQ的维度。多次计算得到多头注意力分数,将多头机制得到的不同注意力分数运用下式进行堆叠,式中i=1,2,3,4,得到注意力特征A1。运用下式将A1和时序特征I相加融合后,得到时序融合特征表示 I ~
C A ( I C ) = s o f t m a x W Q I [ W K C ] T d k
A 1 = c a t ( C A i ( I C ) )
I ~ = A 1 + I
将ShuffleNetV2模型的空间特征C作为查询Q,1DCNN-BiGRU模型捕获的时序特征I作为键K和值V,同样使用上述算法得到注意力特征A2,将特征表示A2和空间特征C通过下式相加融合后,得到空间融合特征表示 C ~,受注意力机制的限制,需将 C ~进行线性变换以确保和 I ~处于同一维度,因此将得到的空间融合特征 C ~和时序融合特征 I ~通过下式进行拼接得到最终时空融合特征表达U,最后将U输入至全连接层中进行分类,得到识别结果。
C ~ = A 2 + C
U = c a t ( I ~ L i n e a r ( C ~ ) )
试验数据集来源于文献[15]。为了识别不同类型的气体并确定其浓度,使用Seek紧凑型热像仪检测不同气体释放时的温度,并用7个间隔1 mm的金属氧化物气体传感器收集气体泄漏数据,创建多源气体检测数据集,其包括4种气源:喷洒香水产生的气体、点燃香火产生的气体(含CO、NO2、CO2和SO2及微量其他气体)、2种气体混合以及新鲜空气。总共收集了6 400个样本,每类1 600个。
试验基于Pytorch2.0.1和PyCharm平台编程,使用预训练的ShuffleNetV2模型提取空间特征。1DCNN-BiGRU模型和交叉注意力机制的主要参数见表1。随机选取数据集70%作为训练集,剩余30%作为测试集以验证模型的泛化能力。
模型训练完成后,训练集以及测试集的准确率和损失函数变化曲线如图3所示。由图3可知:第10次迭代后,训练集和测试集的准确率逐渐稳定,训练集的测试率为99.6%,测试集的准确率为99.2%,损失函数值在0~0.04内波动,说明所构建的模型鲁棒性较高,误差较小。
为验证所提模型的有效性,选取使用气体传感器数据、热像仪数据以及数据融合的3类基线模型进行对比,各模型如下:
1) 单一气体传感器数据。CNN-BiGRU:在文中提出的CNN-BiGRU网络结构末端添加全连接层,其参数设置和表1保持一致。CNN:由2层卷积层、池化层以及全连接层构成,其参数设置和表1中CNN相同。BiGRU:由一层双向GRU层和全连接层构成,其参数设置与表1中BiGRU相同。SVM[16]:采用径向基函数作为核函数以适应此次任务需求,其余参数均使用默认值。
2) 单一热像仪数据。MobileNetV3[17]:采用PyTorch中的预训练模型,参数均使用默认值。ShuffleNetV2:采用Pytorch中的预训练模型,参数均使用默认值。ResNet18[18]:采用Pytorch中的预训练模型,参数均使用默认值。
3) 数据融合。特征相加的多源数据融合模型(ShuffleNetV2-1DCNN-BiGRU,SCG):将ShuffleNetV2提取的空间特征C和1DCNN-BiGRU提取的时序特征I直接相加进行数据融合,其参数设置和表1参数保持一致。
采用AC、PR、RC、F1、MCC作为评价指标,各模型评价结果如图4所示。
通过分析发现:①在使用气体传感器数据的模型中,CNN-BiGRU的性能最好,准确率达到95.10%,说明CNN和BiGRU结合能够有效捕获数据中特征,提升识别准确率。②在使用热像仪的传感器数据的3种模型中,ShuffleNetV2的准确率最高为98.18%,综合表现最好。③在使用数据融合技术的模型中,使用交叉注意力机制后,SCGA模型性能明显提升,准确率由98.28%上升到99.22%,证明交叉注意力机制通过建立热像仪数据和气体传感器数据之间的特征交互,提升了模型性能。④与使用单一数据源的模型相比,基于数据融合技术的模型表现更好,说明通过多源数据融合可以增强特征表达,提高气体检测准确率。
为验证文中方法的优势,对比近期在同一数据集上进行的其他气体泄漏检测研究方法,对比结果见表2。由表2可知:文中所提方法准确率达到99.2%,高于文献[719-20]的中期融合方法,与文献[20]的多任务融合方法准确率基本相同,且文中方法所使用的网络数量更少,复杂度较低,计算成本更低有利于气体的快速检测。
模型的可训练参数量的大小反映了模型运行效率,参数量越小其运行效率越高。各模型参数量见表3。通过对比发现:①基于热图像的模型参数量普遍大于基于气体传感器数据的模型,其中,ShuffleNetV2的参数量最少。②使用交叉注意力虽然使模型性能有所提高,但是模型参数量也有所增加,计算成本也有所提升。
为探究交叉注意力机制的特征融合维度对模型性能的影响,分别选取特征融合维度为64、128、256、512进行试验分析,其评价指标如图5所示。由图5可知:当融合特征维度为128时,模型表现最好,准确率达到99.2%。维度继续增加时,各项指标开始下降,说明过小的融合维度无法充分表达特征,过大的特征融合维度会导致数据失真,影响模型性能。
1) SCGA模型实现了气体传感器和热像仪数据的特征层融合,识别准确率达99.22%,损失值在0~0.04间波动。相比仅用气体传感器数据的模型,SCGA识别率提高4.12%;相比仅用热像仪数据的模型,提升1.14%;相比特征相加融合的SCG模型,提升1%。
2) 交叉注意力机制能在少量增加参数量的情况下显著提高模型性能;同时,交叉注意力的特征融合维度会对模型性能产生影响,当维度为128时模型性能最好。
3) 文中提出的基于交叉注意力的多源数据融合模型,可准确识别管道单种及多种混合气体泄漏,并对不同类型气体采取针对性防控措施,减少生命财产损失。然而,文中研究忽略了混合气体浓度及变化环境中的气体识别。未来计划收集多种气体在不同环境条件下的组合数据集,以提升模型鲁棒性。
  • 常州市国际科技合作项目(CZ20210026)
参考文献 引证文献
排序方式:
[1]
中华人民共和国中央人民政府. 中华人民共和国国民经济和社会发展第十四个五年规划和2035年远景目标纲要[EB/OL]. (2021-03-13). http://www.gov.cn/xinwen/2021-03/13/content_5592681.htm. http://www.gov.cn/xinwen/2021-03/13/content_5592681.htm
[2]
向鹏成, 张子薇, 李卉, 等. 城市地下燃气管道泄漏事故致因因素系统分析[J]. 中国安全科学学报, 2023, 33(12):140-147.
XIANG Pengcheng, ZHANG Ziwei, LI Hui, et al. Systematic analysis on causative factors for gas pipeline leakage accidents in urban underground[J]. China Safety Science Journal, 2023, 33(12):140-147.
[3]
ATTALLAH O, MORISI I. An electronic nose for identifying multiple combustible/harmful gases and their concentration levels via artificial intelligence[J]. Measurement, 2022,199:DOI:10.1016/j.measurement.2022.111458.
[4]
李龙, 应滨州, 李华曜, 等. 电子鼻多组分气体检测算法与性能研究[J]. 仪表技术与传感器, 2023(11):1-6,11.
LI Long, YING Binzhou, LI Huayao, et al. Algorithm and performance study of electronic nose for multi-component gas detection[J]. Instrument Technique and Sensor, 2023(11):1-6,11.
[5]
RAHMAN C A, ROGERS S, et al. Tensor-based approach for liquefied natural gas leakage detection from surveillance thermal cameras: a feasibility study in rural areas[J]. IEEE Transactions on Industrial Informatics, 2021, 17(12): 8122-8130.
[6]
WANG Jingfan, JI Jingwei, RAVIKUMAR A P, et al. VideoGasNet: deep learning for natural gas methane leak classification using an infrared camera[J]. Energy, 2022, 238: DOI:10.1016/j.energy.2021.121516.
[7]
NARKHEDE P, WALAMBE R, MANDAOKAR S, et al. Gas detection and identification using multimodal artificial intelligence based sensor fusion[J]. Applied System Innovation, 2021, 4(1):DOI:10.3390/asi4010003.
[8]
杨余, 杨鑫, 王英, 等. 基于mini-1D-CNN模型的TE过程故障诊断[J]. 中国安全科学学报, 2023, 33(2):173-178.
YANG Yu, YANG Xin, WANG Ying, et al. Fault diagnosis of TE process based on mini-1D-CNN model[J]. China Safety Science Journal, 2023, 33(2):173-178.
[9]
梁宏涛, 刘硕, 杜军威, 等. 深度学习应用于时序预测研究综述[J]. 计算机科学与探索, 2023, 17(6):1285-1300.
LIANG Hongtao, LIU Shuo, DU Junwei. et al. A review of the application of deep learning in time series prediction research[J]. Journal of Frontiers of Computer Science and Technology, 2023, 17(6):1285-1300.
[10]
HAN Jin, YANG Yonghao. L-Net: lightweight and fast object detector-based ShuffleNetV2[J]. Journal of Real-time Image Processing, 2021, 18(6): 2527-2538.
[11]
JI Jundong, XU Cheng, ZHANG Xiaodan, et al. Spatio-temporal memory attention for image captioning[J]. IEEE Transactions on Image Processing, 2020, 29: 7615-7628.
[12]
田宝柱, 徐文涛, 梁鹏, 等. 基于多传感器融合的埋地输水管道泄漏声发射定位方法[J]. 科学技术与工程, 2023, 23(24):10307-10 316.
TIAN Baozhu, XU Wentao, LIANG Peng, et al. Acoustic emission localization method of water pipeline based on multi-sensor fusion[J]. Science Technology and Engineering, 2023, 23(24):10307-10 316.
[13]
王欣, 干镞锐, 许雅玺, 等. 基于字词向量融合的民航智慧监管短文本分类[J]. 中国安全科学学报, 2024, 34(2):37-44.
WANG Xin, GAN Zurui, XU Yaxi, et al. Short text classification of civil aviation intelligent supervision based on character-word fusion[J]. China Safety Science Journal, 2024, 34(2):37-44.
[14]
赵宏, 郭岚, 陈志文, 等. 基于多模态融合与多层注意力的视频内容文本表述研究[J]. 计算机工程, 2022, 48(10):45-54.
ZHAO Hong, GUO Lan, CHEN Zhiwen, et al. Research on video content text representation based on multimodal fusion and multilayer attention[J]. Computer Engineering, 2022, 48(10):45-54.
[15]
NARKHEDE P, WALAMBE R, CHANDEL P, et al. MultimodalGasData: multimodal dataset for gas detection and classification[J]. Data, 2022, 7(8):DOI:10.3390/data7080112.
[16]
朱馨, 李建微, 郭伟, 等. 基于机器学习的森林火险预测模型[J]. 中国安全科学学报, 2022, 32(9):152-157.
ZHU Xin, LI Jianwei, GUO Wei, et al. Forest fire risk prediction model based on machine learning[J]. China Safety Science Journal, 2022, 32(9):152-157.
[17]
梁秀满, 安金铭, 曹晓华, 等. 基于改进MobileNetV3烧结断面火焰图像识别[J]. 电子测量技术, 2023, 46(14):182-187.
LIANG Xiuman, AN Jinming, CAO Xiaohua, et al. Flame image recognition of sintering section based on improve MobileNetV3[J]. Electronic Measurement Technology, 2023, 46(14):182-187.
[18]
刘飞, 陈仁文, 邢凯玲, 等. 基于迁移学习与深度残差网络的滚动轴承快速故障诊断算法[J]. 振动与冲击, 2022, 41(3):154-164.
LIU Fei, CHEN Renwen, XING Kailing, et al. Fast fault diagnosis algorithm for rolling bearing based on transfer learning and deep residual networks[J]. Journal of Vibration and Shock, 2022, 41(3):154-164.
[19]
RAHATE A, MANDAOKAR S, CHANDEL P, et al. Employing multimodal co-learning to evaluate the robustness of sensor fusion for industry 5.0 tasks[J]. Soft Computing, 2023, 27(7): 4139-4155.
[20]
ATTALLAH O. Multitask deep learning-based pipeline for gas leakage detection via E-nose and thermal imaging multimodal fusion[J]. Chemosensors, 2023, 11(7):DOI:10.3390/chemosensors11070364.
2024年第34卷第7期
PDF下载
312
122
引用本文
BibTeX
文章信息
doi: 10.16265/j.cnki.issn1003-3033.2024.07.0135
  • 接收时间:2024-01-12
  • 首发时间:2025-07-09
  • 出版时间:2024-07-28
补充材料
相关文章
文章信息
作者
出版历史
  • 收稿日期:2024-01-12
  • 修回日期:2024-04-22
基金
常州市国际科技合作项目(CZ20210026)
作者信息
    1 常州大学 安全科学与工程学院,江苏 常州 213164
    2 中国安全生产科学研究院 交通安全研究所,北京 100012
    3 中国石油化工股份有限公司 华东油气分公司泰州采油厂,江苏 泰州 225300
参考文献
分享链接
https://castjournals.cast.org.cn/joweb/zgaqkxxb/CN/10.16265/j.cnki.issn1003-3033.2024.07.0135
分享至
全文二维码

扫描看全文

引用本文
BibTeX
本文的引用情况
2种不同金属材料的力学参数

Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)

Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏