Article(id=1227591040442499959, tenantId=1146029695717560320, journalId=1225147924628267009, issueId=1227591023870800760, articleNumber=null, orderNo=null, doi=10.16385/j.cnki.issn.1004-4523.202307050, pmid=null, cstr=null, oa=null, hot=null, price=null, onlineType=0, articleFormat=0, articleType=null, articleTypeStr=null, receivedDate=1689523200000, receivedDateStr=2023-07-17, revisedDate=1697904000000, revisedDateStr=2023-10-22, acceptedDate=null, acceptedDateStr=null, onlineDate=1770610111501, onlineDateStr=2026-02-09, pubDate=1754755200000, pubDateStr=2025-08-10, doiRegisterDate=null, doiRegisterDateStr=null, onlineIssueDate=1770610111501, onlineIssueDateStr=2026-02-09, onlineJustAcceptDate=null, onlineJustAcceptDateStr=null, onlineFirstDate=null, onlineFirstDateStr=null, sourceXml=null, magXml=null, createTime=1770610111501, creator=13701087609, updateTime=1770610111501, updator=13701087609, issue=Issue{id=1227591023870800760, tenantId=1146029695717560320, journalId=1225147924628267009, year='2025', volume='38', issue='8', pageStart='1645', pageEnd='1934', issueExtLink='null', onlineDate='null', pubDate='null', beforeIssueId=null, nextIssueId=null, price=null, status=1, issueComplete=1, articleOrder=1, issueType=-1, specialIssue=0, createTime=1770610107611, creator=13701087609, updateTime=1770610373804, updator=13701087609, preIssue=null, nextIssue=null, ext={EN=IssueExt(id=1227592140348388157, tenantId=1146029695717560320, journalId=1225147924628267009, issueId=1227591023870800760, language=EN, specialIssueTitle=, coverIllustrator=null, specialIssueEditor=, specialIssueAbout=), CN=IssueExt(id=1227592140348388158, tenantId=1146029695717560320, journalId=1225147924628267009, issueId=1227591023870800760, language=CN, specialIssueTitle=, coverIllustrator=null, specialIssueEditor=, specialIssueAbout=)}, issueFiles=null}, startPage=1756, endPage=1763, ext={EN=ArticleExt(id=1227591040920650648, articleId=1227591040442499959, tenantId=1146029695717560320, journalId=1225147924628267009, language=EN, title=Mechanical fault diagnosis method based on neural ordinary differential equations, columnId=null, journalTitle=Journal of Vibration Engineering, columnName=null, runingTitle=null, highlight=null, articleAbstract=

Based on the problems of poor interpretability,as well as parameter increase and memory consumption caused by blind stacking layers in traditional fault diagnosis method based on deep learning,Neural ordinary differential equation (NODE) is introduced into mechanical fault diagnosis,the network structure of NODE for machinery fault diagnosis is constructed. In the constructed structure,the derivatives of the parameterized hidden states of the neural network are used to replace the discrete sequences of the specified hidden layers. By constructing a nonlinear relationship between fault data and fault types,an ordinary differential equation solver (ODE solver) is used to complete the classification of different fault types,and an end-to-end fault diagnosis model is formed. The proposed method is applied to mechanical fault diagnosis to build a specific NODE network model,and the classification task of different fault categories is accomplished through the input of fault data. The constructed model is applied to the fault diagnosis of spindle bearing in the aircraft engine,and compared with the fault diagnosis method based on residual network model. The experimental results show that the constructed model and residual network model have satisfactory accuracy. However,the constructed model not only reduces the memory consumption,but also reduces the number of model parameters by almost five times.

, correspAuthors=null, authorNote=null, correspAuthorsNote=null, copyrightStatement=null, copyrightOwner=null, extLink=null, articleAbsUrl=null, sourceXml=null, magXml=null, pdfUrl=null, pdf=null, pdfFileSize=null, pdfExtLink=null, richHtmlUrl=null, mobilePdfUrl=null, reviewReport=null, pdfFirstPage=null, abstractGraph=null, abstractGraphContent=null, abstractVideo=null, citation=null, cebUrl=null, magXmlContent=null, mapNumber=null, authorCompany=null, fund=null, authors=null, authorsList=Biao GUO, Zhinong LI), CN=ArticleExt(id=1227591045832179826, articleId=1227591040442499959, tenantId=1146029695717560320, journalId=1225147924628267009, language=CN, title=基于神经常微分方程的机械故障诊断方法, columnId=0, journalTitle=振动工程学报, columnName=, runingTitle=null, highlight=null, articleAbstract=

针对传统的深度学习故障诊断方法中存在架构可解释性差以及盲目堆叠层数导致的参数增加和内存消耗等问题,将神经常微分方程(neural ordinary differential equations,NODE)引入到机械故障诊断中。搭建面向机械故障诊断的神经常微分方程网络架构,利用神经网络参数化隐藏状态的导数代替指定隐藏层的离散序列。通过构建故障数据与故障类型的非线性关系,使用常微分方程求解器(ODE solver)完成对不同故障类别的分类任务,形成一种端对端的故障诊断模式。将该方法应用到机械故障诊断领域,搭建特定的神经常微分方程网络模型,通过故障数据的输入完成对不同故障类别的分类任务。将该模型应用到航空发动机主轴轴承故障诊断中,并与残差网络模型的故障诊断方法进行对比。试验结果表明,在确保准确率不降低的情况下,该方法不仅减少了内存消耗,而且将模型参数数量减少了将近五倍。

, correspAuthors=null, authorNote=null, correspAuthorsNote=
李志农(1966—),男,博士,教授。E-mail:
, copyrightStatement=null, copyrightOwner=null, extLink=null, articleAbsUrl=null, sourceXml=lvBJOcKcFI7YklGPIMt34g==, magXml=9Rfrzvv2NbOS8gUkOx1qcQ==, pdfUrl=null, pdf=EJTHE3+pzXt1b9ScdcuIFA==, pdfFileSize=2071248, pdfExtLink=null, richHtmlUrl=null, mobilePdfUrl=null, reviewReport=null, pdfFirstPage=null, abstractGraph=x3XJ/j6/Kga2L4lJxNb4dQ==, abstractGraphContent=null, abstractVideo=null, citation=null, cebUrl=null, magXmlContent=5K33LALBBVD+FDge13jaoQ==, mapNumber=null, authorCompany=null, fund=null, authors=

郭彪(1998—),男,硕士研究生。E-mail:

, authorsList=郭彪, 李志农)}, authors=[Author(id=1227653577896821685, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, orderNo=0, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=guobiao980315@163.com, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1227653578043622336, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, authorId=1227653577896821685, language=EN, stringName=Biao GUO, firstName=Biao, middleName=null, lastName=GUO, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, address=1.Key Laboratory of Nondestructive Testing Ministry of Education,Nanchang Hangkong University,Nanchang 330063,China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1227653578211394512, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, authorId=1227653577896821685, language=CN, stringName=郭彪, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, address=1.南昌航空大学无损检测技术教育部重点实验室,江西 南昌 330063, bio={"content":"

郭彪(1998—),男,硕士研究生。E-mail:

"}, bioImg=null, bioContent=

郭彪(1998—),男,硕士研究生。E-mail:

, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1227653577594831777, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, xref=1., ext=[AuthorCompanyExt(id=1227653577599026083, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, companyId=1227653577594831777, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1.Key Laboratory of Nondestructive Testing Ministry of Education,Nanchang Hangkong University,Nanchang 330063,China), AuthorCompanyExt(id=1227653577607414691, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, companyId=1227653577594831777, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1.南昌航空大学无损检测技术教育部重点实验室,江西 南昌 330063)])]), Author(id=1227653578328835036, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, orderNo=1, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=lizhinong@tsinghua.org.cn, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1227653578463052777, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, authorId=1227653578328835036, language=EN, stringName=Zhinong LI, firstName=Zhinong, middleName=null, lastName=LI, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, 2, address=1.Key Laboratory of Nondestructive Testing Ministry of Education,Nanchang Hangkong University,Nanchang 330063,China
2.Key Laboratory of Intelligent Manufacturing Technology (Shantou University),Ministry of Education,Shantou 515063,China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1227653578576298993, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, authorId=1227653578328835036, language=CN, stringName=李志农, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, 2, address=1.南昌航空大学无损检测技术教育部重点实验室,江西 南昌 330063
2.汕头大学智能制造技术教育部重点实验室,广东 汕头 515063, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1227653577594831777, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, xref=1., ext=[AuthorCompanyExt(id=1227653577599026083, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, companyId=1227653577594831777, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1.Key Laboratory of Nondestructive Testing Ministry of Education,Nanchang Hangkong University,Nanchang 330063,China), AuthorCompanyExt(id=1227653577607414691, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, companyId=1227653577594831777, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1.南昌航空大学无损检测技术教育部重点实验室,江西 南昌 330063)]), AuthorCompany(id=1227653577758409641, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, xref=2., ext=[AuthorCompanyExt(id=1227653577775186860, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, companyId=1227653577758409641, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2.Key Laboratory of Intelligent Manufacturing Technology (Shantou University),Ministry of Education,Shantou 515063,China), AuthorCompanyExt(id=1227653577779381165, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, companyId=1227653577758409641, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2.汕头大学智能制造技术教育部重点实验室,广东 汕头 515063)])])], keywords=[Keyword(id=1227653578848927749, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, language=EN, orderNo=1, keyword=fault diagnosis), Keyword(id=1227653578970562577, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, language=EN, orderNo=2, keyword=neural ordinary differential equation), Keyword(id=1227653579180277796, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, language=EN, orderNo=3, keyword=dynamics system), Keyword(id=1227653579280941100, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, language=EN, orderNo=4, keyword=residual network), Keyword(id=1227653580711198783, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, language=CN, orderNo=1, keyword=故障诊断), Keyword(id=1227653580824444998, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, language=CN, orderNo=2, keyword=神经常微分方程), Keyword(id=1227653580899942480, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, language=CN, orderNo=3, keyword=动力学系统), Keyword(id=1227653581013188703, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, language=CN, orderNo=4, keyword=残差网络)], refs=[Reference(id=1227653587665355269, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, doi=null, pmid=null, pmcid=null, year=2018, volume=108, issue=null, pageStart=33, pageEnd=47, url=null, language=null, rfNumber=[1], rfOrder=0, authorNames=LIU R N, YANG B Y, ZIO E, journalName=Mechanical Systems and Signal Processing, refType=null, unstructuredReference=LIU R NYANG B YZIO E,et al.Artificial intelligence for fault diagnosis of rotating machinery:a review[J]. Mechanical Systems and Signal Processing2018,108:33-47., articleTitle=Artificial intelligence for fault diagnosis of rotating machinery:a review, refAbstract=null), Reference(id=1227653587803767307, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, doi=null, pmid=null, pmcid=null, year=2017, volume=111, issue=null, pageStart=1, pageEnd=10, url=null, language=null, rfNumber=[2], rfOrder=1, authorNames=JING L Y, ZHAO M, LI P, journalName=Measurement, refType=null, unstructuredReference=JING L YZHAO MLI P,et al.A convolutional neural network based feature learning and fault diagnosis method for the condition monitoring of gearbox[J]. Measurement2017,111:1-10., articleTitle=A convolutional neural network based feature learning and fault diagnosis method for the condition monitoring of gearbox, refAbstract=null), Reference(id=1227653587937985045, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, doi=null, pmid=null, pmcid=null, year=2019, volume=95, issue=null, pageStart=295, pageEnd=305, url=null, language=null, rfNumber=[3], rfOrder=2, authorNames=ZHANG W, LI X, DING Q, journalName=ISA Transactions, refType=null, unstructuredReference=ZHANG WLI XDING Q. Deep residual learning-based fault diagnosis method for rotating machinery[J]. ISA Transactions2019,95:295-305., articleTitle=Deep residual learning-based fault diagnosis method for rotating machinery, refAbstract=null), Reference(id=1227653588021871129, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, doi=null, pmid=null, pmcid=null, year=2024, volume=48, issue=1, pageStart=39, pageEnd=47, url=null, language=null, rfNumber=[4], rfOrder=3, authorNames=时培明, 吴术平, 于越, journalName=燕山大学学报, refType=null, unstructuredReference=时培明,吴术平,于越,等.基于注意力机制和深度残差网络的滚动轴承故障诊断[J].燕山大学学报2024,48(1):39-47., articleTitle=基于注意力机制和深度残差网络的滚动轴承故障诊断, refAbstract=null), Reference(id=1227653588164477478, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, doi=null, pmid=null, pmcid=null, year=2024, volume=48, issue=1, pageStart=39, pageEnd=47, url=null, language=null, rfNumber=[4], rfOrder=4, authorNames=SHI Peiming, WU Shuping, YU Yue, journalName=Journal of Yanshan University, refType=null, unstructuredReference=SHI PeimingWU ShupingYU Yue,et al.Rolling bearing fault diagnosis based on attention mechanism and depth residual network[J]. Journal of Yanshan University2024,48(1):39-47., articleTitle=Rolling bearing fault diagnosis based on attention mechanism and depth residual network, refAbstract=null), Reference(id=1227653588294500908, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, doi=null, pmid=null, pmcid=null, year=2022, volume=41, issue=3, pageStart=154, pageEnd=164, url=null, language=null, rfNumber=[5], rfOrder=5, authorNames=刘飞, 陈仁文, 邢凯玲, journalName=振动与冲击, refType=null, unstructuredReference=刘飞,陈仁文,邢凯玲,等.基于迁移学习与深度残差网络的滚动轴承快速故障诊断算法[J].振动与冲击2022,41(3):154-164., articleTitle=基于迁移学习与深度残差网络的滚动轴承快速故障诊断算法, refAbstract=null), Reference(id=1227653589682815540, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, doi=null, pmid=null, pmcid=null, year=2022, volume=41, issue=3, pageStart=154, pageEnd=164, url=null, language=null, rfNumber=[5], rfOrder=6, authorNames=LIU Fei, CHEN Renwen, XING Kailing, journalName=Journal of Vibration and Shock, refType=null, unstructuredReference=LIU FeiCHEN RenwenXING Kailing,et al.Fast fault diagnosis algorithm for rolling bearing based on transfer learning and deep residual network[J]. Journal of Vibration and Shock2022,41(3):154-164., articleTitle=Fast fault diagnosis algorithm for rolling bearing based on transfer learning and deep residual network, refAbstract=null), Reference(id=1227653589787673143, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, doi=null, pmid=null, pmcid=null, year=2023, volume=29, issue=4, pageStart=1146, pageEnd=1156, url=null, language=null, rfNumber=[6], rfOrder=7, authorNames=池福临, 杨新宇, 邵思羽, journalName=计算机集成制造系统, refType=null, unstructuredReference=池福临,杨新宇,邵思羽,等.基于深度收缩残差网络的轴承变工况故障诊断[J]. 计算机集成制造系统2023,29(4):1146-1156., articleTitle=基于深度收缩残差网络的轴承变工况故障诊断, refAbstract=null), Reference(id=1227653589888336442, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, doi=null, pmid=null, pmcid=null, year=2023, volume=29, issue=4, pageStart=1146, pageEnd=1156, url=null, language=null, rfNumber=[6], rfOrder=8, authorNames=CHI Fulin, YANG Xinyu, SHAO Siyu, journalName=Computer Integrated Manufacturing Systems, refType=null, unstructuredReference=CHI FulinYANG XinyuSHAO Siyu,et al.Bearing fault diagnosis under variable working conditions based on deep residual shrinkage networks[J].Computer Integrated Manufacturing Systems2023,29(4):1146-1156., articleTitle=Bearing fault diagnosis under variable working conditions based on deep residual shrinkage networks, refAbstract=null), Reference(id=1227653590030942789, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, doi=null, pmid=null, pmcid=null, year=2021, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=[7], rfOrder=9, authorNames=尚杰, journalName=null, refType=null, unstructuredReference=尚杰. 基于深度残差网络的旋转机械故障诊断[D]. 青岛: 青岛理工大学,2021., articleTitle=基于深度残差网络的旋转机械故障诊断, refAbstract=null), Reference(id=1227653590110634569, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, doi=null, pmid=null, pmcid=null, year=2021, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=[7], rfOrder=10, authorNames=SHANG Jie, journalName=null, refType=null, unstructuredReference=SHANG Jie. Fault diagnosis of rotating machinery based on deep residual network[D]. Qingdao: Qingdao University of Technology,2021., articleTitle=Fault diagnosis of rotating machinery based on deep residual network, refAbstract=null), Reference(id=1227653590198714962, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, doi=null, pmid=null, pmcid=null, year=2022, volume=44, issue=6, pageStart=2051, pageEnd=2059, url=null, language=null, rfNumber=[8], rfOrder=11, authorNames=侯召国, 王华伟, 周良, journalName=系统工程与电子技术, refType=null, unstructuredReference=侯召国,王华伟,周良,等.基于改进深度残差网络的旋转机械故障诊断[J]. 系统工程与电子技术2022,44(6):2051-2059., articleTitle=基于改进深度残差网络的旋转机械故障诊断, refAbstract=null), Reference(id=1227653590324544089, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, doi=null, pmid=null, pmcid=null, year=2022, volume=44, issue=6, pageStart=2051, pageEnd=2059, url=null, language=null, rfNumber=[8], rfOrder=12, authorNames=HOU Zhaoguo, WANG Huawei, ZHOU Liang, journalName=Systems Engineering and Electronics, refType=null, unstructuredReference=HOU ZhaoguoWANG HuaweiZHOU Liang,et al.Fault diagnosis of rotating machinery based on improved deep residual network[J]. Systems Engineering and Electronics2022,44(6):2051-2059., articleTitle=Fault diagnosis of rotating machinery based on improved deep residual network, refAbstract=null), Reference(id=1227653590412624477, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, doi=null, pmid=null, pmcid=null, year=2023, volume=34, issue=18, pageStart=2212, pageEnd=2221, url=null, language=null, rfNumber=[9], rfOrder=13, authorNames=秦国浩, 张楷, 丁昆, journalName=中国机械工程, refType=null, unstructuredReference=秦国浩,张楷,丁昆,等.动态宽卷积残差网络的轴承故障诊断方法[J]. 中国机械工程2023,34(18):2212-2221., articleTitle=动态宽卷积残差网络的轴承故障诊断方法, refAbstract=null), Reference(id=1227653590525870690, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, doi=null, pmid=null, pmcid=null, year=2023, volume=34, issue=18, pageStart=2212, pageEnd=2221, url=null, language=null, rfNumber=[9], rfOrder=14, authorNames=QIN Guohao, ZHANG Kai, DING Kun, journalName=China Mechanical Engineering, refType=null, unstructuredReference=QIN GuohaoZHANG KaiDING Kun,et al.Dynamic wide convolutional residual network for bearing fault diagnosis method[J]. China Mechanical Engineering2023,34(18):2212-2221., articleTitle=Dynamic wide convolutional residual network for bearing fault diagnosis method, refAbstract=null), Reference(id=1227653590634922601, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, doi=null, pmid=null, pmcid=null, year=2021, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=[10], rfOrder=15, authorNames=李亮, journalName=null, refType=null, unstructuredReference=李亮. 基于神经常微分方程的时序数据分析与预测[D]. 成都: 电子科技大学,2021., articleTitle=基于神经常微分方程的时序数据分析与预测, refAbstract=null), Reference(id=1227653590756557422, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, doi=null, pmid=null, pmcid=null, year=2021, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=[10], rfOrder=16, authorNames=LI Liang, journalName=null, refType=null, unstructuredReference=LI Liang. Analyzing and forecasting time-series data via neural ordinary differential equations[D]. Chengdu: University of Electronic Science and Technology of China,2021., articleTitle=Analyzing and forecasting time-series data via neural ordinary differential equations, refAbstract=null), Reference(id=1227653590848832118, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, doi=null, pmid=null, pmcid=null, year=2018, volume=null, issue=null, pageStart=6572, pageEnd=6583, url=null, language=null, rfNumber=[11], rfOrder=17, authorNames=CHEN R T Q, RUBANOVA Y, BETTENCOURT J, journalName=null, refType=null, unstructuredReference=CHEN R T QRUBANOVA YBETTENCOURT J,et al.Neural ordinary differential equations[C]// Proceedings of the 32nd International Conference on Neural Information Processing Systems. 2018:6572-6583., articleTitle=Neural ordinary differential equations, refAbstract=null), Reference(id=1227653590966272637, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, doi=null, pmid=null, pmcid=null, year=2016, volume=null, issue=null, pageStart=770, pageEnd=778, url=null, language=null, rfNumber=[12], rfOrder=18, authorNames=HE K M, ZHANG X Y, REN S Q, journalName=null, refType=null, unstructuredReference=HE K MZHANG X YREN S Q,et al.Deep residual learning for image recognition[C]// Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. 2016:770-778., articleTitle=Deep residual learning for image recognition, refAbstract=null), Reference(id=1227653591104684675, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, doi=null, pmid=null, pmcid=null, year=2017, volume=5, issue=1, pageStart=1, pageEnd=11, url=null, language=null, rfNumber=[13], rfOrder=19, authorNames=WEINAN E, journalName=Communications in Mathematics and Statistics, refType=null, unstructuredReference=WEINAN E. A proposal on machine learning via dynamical systems[J]. Communications in Mathematics and Statistics2017,5(1):1-11., articleTitle=A proposal on machine learning via dynamical systems, refAbstract=null), Reference(id=1227653591251485324, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, doi=null, pmid=null, pmcid=null, year=2019, volume=null, issue=null, pageStart=3140, pageEnd=3150, url=null, language=null, rfNumber=[14], rfOrder=20, authorNames=DUPONT E, DOUCET A, TEH Y W, journalName=null, refType=null, unstructuredReference=DUPONT EDOUCET ATEH Y W. Augmented neural ODEs[C]// Proceedings of the 33rd International Conference on Neural Information Processing Systems. 2019:3140-3150., articleTitle=Augmented neural ODEs, refAbstract=null), Reference(id=1227653591364731538, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, doi=null, pmid=null, pmcid=null, year=2020, volume=33, issue=null, pageStart=5911, pageEnd=5921, url=null, language=null, rfNumber=[15], rfOrder=21, authorNames=NORCLIFFE A, BODNAR C, DAY B, journalName=Advances in Neural Information Processing Systems, refType=null, unstructuredReference=NORCLIFFE ABODNAR CDAY B,et al.On second order behaviour in augmented neural ODEs[J]. Advances in Neural Information Processing Systems2020,33:5911-5921., articleTitle=On second order behaviour in augmented neural ODEs, refAbstract=null), Reference(id=1227653591457006230, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, doi=null, pmid=null, pmcid=null, year=2022, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=[16], rfOrder=22, authorNames=KIDGER P, journalName=arXiv, refType=null, unstructuredReference=KIDGER P. On neural differential equations[J]. arXiv preprint arXiv:2022., articleTitle=On neural differential equations, refAbstract=null), Reference(id=1227653591557669532, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, doi=null, pmid=null, pmcid=null, year=2019, volume=120, issue=null, pageStart=252, pageEnd=273, url=null, language=null, rfNumber=[17], rfOrder=23, authorNames=DAGA A P, FASANA A, MARCHESIELLO S, journalName=Mechanical Systems and Signal Processing, refType=null, unstructuredReference=DAGA A PFASANA AMARCHESIELLO S,et al.The Politecnico di Torino rolling bearing test rig:description and analysis of open access data[J]. Mechanical Systems and Signal Processing2019,120:252-273., articleTitle=The Politecnico di Torino rolling bearing test rig:description and analysis of open access data, refAbstract=null), Reference(id=1227653591679304354, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, doi=null, pmid=null, pmcid=null, year=1993, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=[18], rfOrder=24, authorNames=HAIRER E, NORSETT S P, WANNER G, journalName=Solving Ordinary Differential Equations Ⅰ:Nonstiff Problems, refType=null, unstructuredReference=HAIRER ENORSETT S PWANNER G. Solving Ordinary Differential Equations Ⅰ:Nonstiff Problems[M]. 2nd ed. Springer-Verlag,1993., articleTitle=null, refAbstract=null), Reference(id=1227653591817716391, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, doi=null, pmid=null, pmcid=null, year=2020, volume=34, issue=1, pageStart=12, pageEnd=20, url=null, language=null, rfNumber=[19], rfOrder=25, authorNames=李泽东, 李志农, 王成军, journalName=南昌航空大学学报(自然科学版), refType=null, unstructuredReference=李泽东,李志农,王成军. 深度卷积神经网络在轴承多故障复合诊断中应用研究[J]. 南昌航空大学学报(自然科学版)2020,34(1):12-20., articleTitle=深度卷积神经网络在轴承多故障复合诊断中应用研究, refAbstract=null), Reference(id=1227653591922573996, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, doi=null, pmid=null, pmcid=null, year=2020, volume=34, issue=1, pageStart=12, pageEnd=20, url=null, language=null, rfNumber=[19], rfOrder=26, authorNames=LI Zedong, LI Zhinong, WANG Chengjun, journalName=Journal of Nanchang Hangkong University (Natural Sciences), refType=null, unstructuredReference=LI ZedongLI ZhinongWANG Chengjun. Application of deep convolution neural network in bearing multi fault diagnosis[J]. Journal of Nanchang Hangkong University (Natural Sciences)2020,34(1):12-20., articleTitle=Application of deep convolution neural network in bearing multi fault diagnosis, refAbstract=null), Reference(id=1227653592006460081, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, doi=null, pmid=null, pmcid=null, year=2008, volume=9, issue=null, pageStart=2579, pageEnd=2605, url=null, language=null, rfNumber=[20], rfOrder=27, authorNames=VAN DER MAATEN L, HINTON G, journalName=Journal of Machine Learning Research, refType=null, unstructuredReference=VAN DER MAATEN LHINTON G. Visualizing Data using t-SNE[J]. Journal of Machine Learning Research2008,9:2579-2605., articleTitle=Visualizing Data using t-SNE, refAbstract=null)], funds=[Fund(id=1227653587057181153, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, awardId=52075236, language=CN, fundingSource=国家自然科学基金资助项目(52075236), fundOrder=null, country=null), Fund(id=1227653587174621672, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, awardId=20212ACB202005, language=CN, fundingSource=江西省自然科学基金重点项目(20212ACB202005), fundOrder=null, country=null), Fund(id=1227653587300450799, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, awardId=STME2024002, language=CN, fundingSource=智能制造技术教育部重点实验室(汕头大学)开放课基金资助项目(STME2024002), fundOrder=null, country=null), Fund(id=1227653587426279927, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, awardId=2020KCXTD012, language=CN, fundingSource=广东省普通高校创新团队资助项目(2020KCXTD012), fundOrder=null, country=null)], companyList=[AuthorCompany(id=1227653577594831777, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, xref=1., ext=[AuthorCompanyExt(id=1227653577599026083, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, companyId=1227653577594831777, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1.Key Laboratory of Nondestructive Testing Ministry of Education,Nanchang Hangkong University,Nanchang 330063,China), AuthorCompanyExt(id=1227653577607414691, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, companyId=1227653577594831777, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1.南昌航空大学无损检测技术教育部重点实验室,江西 南昌 330063)]), AuthorCompany(id=1227653577758409641, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, xref=2., ext=[AuthorCompanyExt(id=1227653577775186860, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, companyId=1227653577758409641, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2.Key Laboratory of Intelligent Manufacturing Technology (Shantou University),Ministry of Education,Shantou 515063,China), AuthorCompanyExt(id=1227653577779381165, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, companyId=1227653577758409641, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2.汕头大学智能制造技术教育部重点实验室,广东 汕头 515063)])], figs=[ArticleFig(id=1227653581281624187, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, language=EN, label=Fig. 1, caption=Forward and the adjoint sensitivity method of NODE, figureFileSmall=EPmuV9waKbxQACVNleA5Zg==, figureFileBig=f19UNr1GcfQZjPTnPGeR5g==, tableContent=null), ArticleFig(id=1227653581394870404, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, language=CN, label=图1, caption=神经常微分方程前向传递和伴随灵敏度方法, figureFileSmall=EPmuV9waKbxQACVNleA5Zg==, figureFileBig=f19UNr1GcfQZjPTnPGeR5g==, tableContent=null), ArticleFig(id=1227653581562642586, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, language=EN, label=Fig. 2, caption=ResNet model framework diagram, figureFileSmall=9j77cGJXLJzOF4jirpQabA==, figureFileBig=wyGq8bLVPI1pHVMlpYVSgQ==, tableContent=null), ArticleFig(id=1227653581713637542, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, language=CN, label=图2, caption=残差网络模型框架图, figureFileSmall=9j77cGJXLJzOF4jirpQabA==, figureFileBig=wyGq8bLVPI1pHVMlpYVSgQ==, tableContent=null), ArticleFig(id=1227653581902381233, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, language=EN, label=Fig. 3, caption=NODE model framework diagram, figureFileSmall=TTsEnLk5nSdSd10uzIAGJg==, figureFileBig=DgyeZ3oidbwJvQp5s4D1wg==, tableContent=null), ArticleFig(id=1227653582065959098, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, language=CN, label=图3, caption=神经常微分方程网络模型框架图, figureFileSmall=TTsEnLk5nSdSd10uzIAGJg==, figureFileBig=DgyeZ3oidbwJvQp5s4D1wg==, tableContent=null), ArticleFig(id=1227653582191788229, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, language=EN, label=Fig. 4, caption=Test rig of bearing, figureFileSmall=vEySeH6aUNmSixmiguE9Zg==, figureFileBig=yHuMHqQfGwSO9S4kacs30g==, tableContent=null), ArticleFig(id=1227653582296645838, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, language=CN, label=图4, caption=轴承试验台, figureFileSmall=vEySeH6aUNmSixmiguE9Zg==, figureFileBig=yHuMHqQfGwSO9S4kacs30g==, tableContent=null), ArticleFig(id=1227653582422474970, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, language=EN, label=Fig. 5, caption=Training time, figureFileSmall=/sPRSY+gw+iZDF4wn8GIkw==, figureFileBig=RBt61IFld6NZ1RP/ynKpFA==, tableContent=null), ArticleFig(id=1227653582531526884, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, language=CN, label=图5, caption=训练所用时间, figureFileSmall=/sPRSY+gw+iZDF4wn8GIkw==, figureFileBig=RBt61IFld6NZ1RP/ynKpFA==, tableContent=null), ArticleFig(id=1227653582674133232, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, language=EN, label=Fig. 6, caption=Number of function evaluations, figureFileSmall=YH7gfiFsCc5VlehXIOCEbA==, figureFileBig=vu0ZMXpPvxLRT8Oqy/F6NA==, tableContent=null), ArticleFig(id=1227653582804156672, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, language=CN, label=图6, caption=函数评估次数, figureFileSmall=YH7gfiFsCc5VlehXIOCEbA==, figureFileBig=vu0ZMXpPvxLRT8Oqy/F6NA==, tableContent=null), ArticleFig(id=1227653582871265544, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, language=EN, label=Fig. 7, caption=Diagnostic curve of ResNet model, figureFileSmall=8/HQF7NCoua7NTAqjMl/gA==, figureFileBig=QGY1sU1EPAc3VjiejICPcw==, tableContent=null), ArticleFig(id=1227653582942568718, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, language=CN, label=图7, caption=残差网络模型诊断曲线, figureFileSmall=8/HQF7NCoua7NTAqjMl/gA==, figureFileBig=QGY1sU1EPAc3VjiejICPcw==, tableContent=null), ArticleFig(id=1227653583026454805, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, language=EN, label=Fig. 8, caption=Diagnostic curve of NODE model, figureFileSmall=0JIx7NRWIIt0bGlg8kfuVg==, figureFileBig=jb7zoIKloVqlrrwLjeFB+w==, tableContent=null), ArticleFig(id=1227653583152283932, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, language=CN, label=图8, caption=神经常微分方程网络模型诊断曲线, figureFileSmall=0JIx7NRWIIt0bGlg8kfuVg==, figureFileBig=jb7zoIKloVqlrrwLjeFB+w==, tableContent=null), ArticleFig(id=1227653583294890277, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, language=EN, label=Fig. 9, caption=Confusion matrix for ResNet models, figureFileSmall=palIcODtbH3gwf8S//rsdQ==, figureFileBig=yuLUTTBKmiIVd3XrLUFk1w==, tableContent=null), ArticleFig(id=1227653583412330797, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, language=CN, label=图9, caption=残差网络模型的混淆矩阵, figureFileSmall=palIcODtbH3gwf8S//rsdQ==, figureFileBig=yuLUTTBKmiIVd3XrLUFk1w==, tableContent=null), ArticleFig(id=1227653583538159932, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, language=EN, label=Fig. 10, caption=Confusion matrix for NODE models, figureFileSmall=Y2B7QPQZR9M/pP425VGXfA==, figureFileBig=3WjVL8hJXvLiUOxTsG2o+Q==, tableContent=null), ArticleFig(id=1227653583659794758, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, language=CN, label=图10, caption=神经常微分方程网络模型的混淆矩阵, figureFileSmall=Y2B7QPQZR9M/pP425VGXfA==, figureFileBig=3WjVL8hJXvLiUOxTsG2o+Q==, tableContent=null), ArticleFig(id=1227653583802401102, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, language=EN, label=Fig. 11, caption=Visualization of classification results of ResNet and NODE models on the test dataset, figureFileSmall=1VMgXMZma6tp3B4ZrraCpw==, figureFileBig=GRBBY39dUqzLbCEBylupag==, tableContent=null), ArticleFig(id=1227653585224270166, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, language=CN, label=图11, caption=ResNet和NODE模型在测试集上的分类结果可视化, figureFileSmall=1VMgXMZma6tp3B4ZrraCpw==, figureFileBig=GRBBY39dUqzLbCEBylupag==, tableContent=null), ArticleFig(id=1227653585333322077, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, language=EN, label=Tab. 1, caption=

Model architecture and output tensor per layer of ResNet

, figureFileSmall=null, figureFileBig=null, tableContent=
网络层层架构输出
下采样层Conv2D(64,64,1020,1)
ResBlock(64,64,510,1)
ResBlock(64,64,255,1)
残差层ResBlock×6(64,64,255,1)
前馈层GroupNorm(64,64,255,1)
ReLU(64,64,255,1)
Adaptive AvgPool2D(64,64,1,1)
Flatten(64,64)
Linear(64, 7)
), ArticleFig(id=1227653585425596773, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, language=CN, label=表1, caption=

残差网络的模型架构及每层输出张量

, figureFileSmall=null, figureFileBig=null, tableContent=
网络层层架构输出
下采样层Conv2D(64,64,1020,1)
ResBlock(64,64,510,1)
ResBlock(64,64,255,1)
残差层ResBlock×6(64,64,255,1)
前馈层GroupNorm(64,64,255,1)
ReLU(64,64,255,1)
Adaptive AvgPool2D(64,64,1,1)
Flatten(64,64)
Linear(64, 7)
), ArticleFig(id=1227653585530454385, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, language=EN, label=Tab. 2, caption=

Composition of ResBlock

, figureFileSmall=null, figureFileBig=null, tableContent=
层架构输出
GroupNorm(64,64,255,1)
ReLU(64,64,255,1)
Conv2D(64,64,255,1)
GroupNorm(64,64,255,1)
Conv2D(64,64,255,1)
), ArticleFig(id=1227653585647894909, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, language=CN, label=表2, caption=

残差块的构成

, figureFileSmall=null, figureFileBig=null, tableContent=
层架构输出
GroupNorm(64,64,255,1)
ReLU(64,64,255,1)
Conv2D(64,64,255,1)
GroupNorm(64,64,255,1)
Conv2D(64,64,255,1)
), ArticleFig(id=1227653585740169604, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, language=EN, label=Tab. 3, caption=

Hyperparameters selection for ResNet model

, figureFileSmall=null, figureFileBig=null, tableContent=
超参数取值
Epochs160
Train_Batch_size64
Test_Batch_size128
Optimizer_SGD_ momentum0.9
Learning rate0.1
Amount of ResBlock(n)6
), ArticleFig(id=1227653585861804430, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, language=CN, label=表3, caption=

残差网络模型超参数选择

, figureFileSmall=null, figureFileBig=null, tableContent=
超参数取值
Epochs160
Train_Batch_size64
Test_Batch_size128
Optimizer_SGD_ momentum0.9
Learning rate0.1
Amount of ResBlock(n)6
), ArticleFig(id=1227653585958273430, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, language=EN, label=Tab. 4, caption=

Model architecture and output tensor per layer of NODE

, figureFileSmall=null, figureFileBig=null, tableContent=
网络层层架构输出
下采样层Conv2D(64, 64, 1020, 1)
GroupNorm(64, 64, 1020, 1)
ReLU(64, 64, 1020, 1)
Conv2D(64, 64, 510, 1)
GroupNorm(64, 64, 510, 1)
ReLU(64, 64, 510, 1)
Conv2D(64, 64, 255, 1)
神经常微分方程层GroupNorm(64, 64, 255, 1)
ReLU(64, 64, 255, 1)
Conv2D(64, 64, 255,1)
GroupNorm(64, 64, 255, 1)
Conv2D(64, 64, 255, 1)
GroupNorm(64, 64, 255, 1)
前馈层GroupNorm(64, 64, 255, 1)
ReLU(64, 64, 255, 1)
Adaptive AvgPool2D(64,64,1,1)
Flatten(64,64)
Linear(64, 7)
), ArticleFig(id=1227653586054742428, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, language=CN, label=表4, caption=

神经常微分方程网络模型架构及每层输出张量

, figureFileSmall=null, figureFileBig=null, tableContent=
网络层层架构输出
下采样层Conv2D(64, 64, 1020, 1)
GroupNorm(64, 64, 1020, 1)
ReLU(64, 64, 1020, 1)
Conv2D(64, 64, 510, 1)
GroupNorm(64, 64, 510, 1)
ReLU(64, 64, 510, 1)
Conv2D(64, 64, 255, 1)
神经常微分方程层GroupNorm(64, 64, 255, 1)
ReLU(64, 64, 255, 1)
Conv2D(64, 64, 255,1)
GroupNorm(64, 64, 255, 1)
Conv2D(64, 64, 255, 1)
GroupNorm(64, 64, 255, 1)
前馈层GroupNorm(64, 64, 255, 1)
ReLU(64, 64, 255, 1)
Adaptive AvgPool2D(64,64,1,1)
Flatten(64,64)
Linear(64, 7)
), ArticleFig(id=1227653586151211427, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, language=EN, label=Tab. 5, caption=

Hyperparameters selection for NODE model

, figureFileSmall=null, figureFileBig=null, tableContent=
超参数取值
Epochs160
Train_Batch_size64
Test_Batch_size128
Optimizer_SGD_ momentum0.9
Learning rate0. 1
ODE solverRK4
), ArticleFig(id=1227653586260263339, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, language=CN, label=表5, caption=

神经常微分方程网络模型超参数选择

, figureFileSmall=null, figureFileBig=null, tableContent=
超参数取值
Epochs160
Train_Batch_size64
Test_Batch_size128
Optimizer_SGD_ momentum0.9
Learning rate0. 1
ODE solverRK4
), ArticleFig(id=1227653586356732339, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, language=EN, label=Tab. 6, caption=

Aero-engine spindle bearing dataset

, figureFileSmall=null, figureFileBig=null, tableContent=
健康状态故障维度/μm额定转速/Hz额定负载/N方向
正常/内圈故障/滚动体故障150/250/450100/200/300/400/5000/1000/1400/1800x/y/z
), ArticleFig(id=1227653586486755770, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, language=CN, label=表6, caption=

航空发动机主轴轴承数据集

, figureFileSmall=null, figureFileBig=null, tableContent=
健康状态故障维度/μm额定转速/Hz额定负载/N方向
正常/内圈故障/滚动体故障150/250/450100/200/300/400/5000/1000/1400/1800x/y/z
), ArticleFig(id=1227653586742608327, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, language=EN, label=Tab. 7, caption=

Comparison of experimental results of the two models

, figureFileSmall=null, figureFileBig=null, tableContent=
模型指标ResNetNODE
准确率/%96.6198.93
参数数量601031117703
内存占用/MiB33562654
), ArticleFig(id=1227653586843271630, tenantId=1146029695717560320, journalId=1225147924628267009, articleId=1227591040442499959, language=CN, label=表7, caption=

两种模型试验结果对比

, figureFileSmall=null, figureFileBig=null, tableContent=
模型指标ResNetNODE
准确率/%96.6198.93
参数数量601031117703
内存占用/MiB33562654
)], attaches=null, journal=Journal(id=1225147830491308032, delFlag=0, nameCn=振动工程学报, nameEn=Journal of Vibration Engineering, nameHistory1=null, nameHistory2=null, issn=1004-4523, eissn=null, cn=32-1349/TB, coden=null, periodic=0, language=CN, oaType=null, ccby=null, superviseOffice=null, ownerOffice=null, pubOffice=null, editorOffice=null, officeType=null, aims=null, clcCode=null, officeProv=null, officeCity=null, officeAddr=null, officeZip=null, officeEmail=null, officePhone=null, editDirector=null, officeDirector=null, officeDirectorPhone=null, officeStaffNum=null, officeEmpNum=null, coverPicUrl=null, journalPrice=null, startedYear=null, abbrevIsoEn=Journal of Vibration Engineering, journalRemark=null, publicationField=null, createdTime=1770027604939, updatedTime=1770169610881, createdBy=18614031015, updatedBy=18614031015, firstLetterCn=J, firstLetterEn=J, subjectCode=Engineering, subjectName=null, subjectCodeEn=Engineering, subjectNameEn=null, picCn=null, picEn=null, jcr=null, cjcr=null, exts=[JournalExt(id=1225743346702925905, language=CN, name=振动工程学报, nameHistory1=null, nameHistory2=null, managedBy=中国科学技术协会, sponsoredBy=中国振动工程学会, publishedBy=, editorOffice=, officeProv=null, officeCity=null, officeAddr=, officeZip=, editDirector=, officeDirector=null, officePhone=null, coverPicUrl=null, journalRemark=, submitArticleUrl=null, websiteUrl=, createdTime=1770169587064, updatedTime=1770169587064, createdBy=13701087609, updatedBy=13701087609, submissionGuidelinesUrl=, submissionAuthorUrl=https://www.manuscripts.com.cn/zdgcxb, submissionEditorUrl=https://www.manuscripts.com.cn/zdgcxb, submissionReviewUrl=https://www.manuscripts.com.cn/zdgcxb, submissionCeEditorUrl=, submissionAeEditorUrl=, option={"copyright":""}), JournalExt(id=1225743346765840466, language=EN, name=Journal of Vibration Engineering, nameHistory1=null, nameHistory2=null, managedBy=, sponsoredBy=, publishedBy=, editorOffice=, officeProv=null, officeCity=null, officeAddr=, officeZip=, editDirector=, officeDirector=null, officePhone=null, coverPicUrl=null, journalRemark=, submitArticleUrl=null, websiteUrl=, createdTime=1770169587079, updatedTime=1770169587079, createdBy=13701087609, updatedBy=13701087609, submissionGuidelinesUrl=, submissionAuthorUrl=https://www.manuscripts.com.cn/zdgcxb, submissionEditorUrl=https://www.manuscripts.com.cn/zdgcxb, submissionReviewUrl=https://www.manuscripts.com.cn/zdgcxb, submissionCeEditorUrl=, submissionAeEditorUrl=, option={"copyright":""})], databaseList=null, tenantJournalId=1225147924628267009, websiteList=[Website(id=1225150618881404985, webName=null, webTitle=null, webDomain=null, webCopyrigh=null, webIpcNo=null, seoTitle=null, seoKeywords=null, seoDescription=null, tenantJournalId=null, journalId=1225147924628267009, journalNameCn=null, journalNameEn=null, grayFlag=null, tenantId=1146029695717560320, platformId=null, journalGroupId=null, journalGroupNameCn=null, journalGroupNameEn=null, type=1, domain=https://castjournals.cast.org.cn/joweb/zdgcxb/CN, language=CN, createTime=1770028269739, createBy=18614031015, updateTime=1770028293069, updateBy=18614031015, name=振动工程学报-中文, tplId=1146099689490845704, title=振动工程学报, delFlag=0, indexPage=/home, props=[WebsiteProps(id=1225151164178673750, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1225150618881404985, code=articleTextType, value=kx, createTime=1770028399748, updateTime=1770028399748, creator=18614031015, updator=18614031015), WebsiteProps(id=1225151164157702227, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1225150618881404985, code=banner, value=null, createTime=1770028399743, updateTime=1770028399743, creator=18614031015, updator=18614031015), WebsiteProps(id=1225151164203839577, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1225150618881404985, code=grayFlag, value=0, createTime=1770028399754, updateTime=1770028399754, creator=18614031015, updator=18614031015), WebsiteProps(id=1225151164145119314, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1225150618881404985, code=logo, value=https://castjournals.cast.org.cn/joweb/zdgcxb/EN/file/pic?fileId=L7mSU8YPwm66NWFMoTG4aQ==, createTime=1770028399740, updateTime=1770028399740, creator=18614031015, updator=18614031015), WebsiteProps(id=1225151164212228187, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1225150618881404985, code=minRunFlag, value=0, createTime=1770028399756, updateTime=1770028399756, creator=18614031015, updator=18614031015), WebsiteProps(id=1225151164170285141, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1225150618881404985, code=picServerUrl, value=https://castjournals.cast.org.cn/joweb/zdgcxb/CN/file/pic, createTime=1770028399746, updateTime=1770028399746, creator=18614031015, updator=18614031015), WebsiteProps(id=1225151164208033882, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1225150618881404985, code=silenceFlag, value=0, createTime=1770028399755, updateTime=1770028399755, creator=18614031015, updator=18614031015), WebsiteProps(id=1225151164166090836, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1225150618881404985, code=staticResourcePath, value=https://castjournals.cast.org.cn/joweb/cast_kjdb_cn_619/, createTime=1770028399745, updateTime=1770028399745, creator=18614031015, updator=18614031015), WebsiteProps(id=1225151164187062359, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1225150618881404985, code=themeColor, value=null, createTime=1770028399750, updateTime=1770028399750, creator=18614031015, updator=18614031015), WebsiteProps(id=1225151164195450968, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1225150618881404985, code=themeStyle, value=null, createTime=1770028399752, updateTime=1770028399752, creator=18614031015, updator=18614031015)]), Website(id=1225150619003039804, webName=null, webTitle=null, webDomain=null, webCopyrigh=null, webIpcNo=null, seoTitle=null, seoKeywords=null, seoDescription=null, tenantJournalId=null, journalId=1225147924628267009, journalNameCn=null, journalNameEn=null, grayFlag=null, tenantId=1146029695717560320, platformId=null, journalGroupId=null, journalGroupNameCn=null, journalGroupNameEn=null, type=1, domain=https://castjournals.cast.org.cn/joweb/zdgcxb/EN, language=EN, createTime=1770028269768, createBy=18614031015, updateTime=1770028309190, updateBy=18614031015, name=振动工程学报-英文, tplId=1146101810881728533, title=Journal of Vibration Engineering, delFlag=0, indexPage=/home, props=[WebsiteProps(id=1225151193366835296, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1225150619003039804, code=articleTextType, value=kx, createTime=1770028406707, updateTime=1770028406707, creator=18614031015, updator=18614031015), WebsiteProps(id=1225151193350058077, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1225150619003039804, code=banner, value=null, createTime=1770028406703, updateTime=1770028406703, creator=18614031015, updator=18614031015), WebsiteProps(id=1225151193387806819, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1225150619003039804, code=grayFlag, value=0, createTime=1770028406712, updateTime=1770028406712, creator=18614031015, updator=18614031015), WebsiteProps(id=1225151193341669468, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1225150619003039804, code=logo, value=https://castjournals.cast.org.cn/joweb/zdgcxb/EN/file/pic?fileId=L7mSU8YPwm66NWFMoTG4aQ==, createTime=1770028406701, updateTime=1770028406701, creator=18614031015, updator=18614031015), WebsiteProps(id=1225151193400389733, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1225150619003039804, code=minRunFlag, value=0, createTime=1770028406715, updateTime=1770028406715, creator=18614031015, updator=18614031015), WebsiteProps(id=1225151193362640991, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1225150619003039804, code=picServerUrl, value=https://castjournals.cast.org.cn/joweb/zdgcxb/EN/file/pic, createTime=1770028406706, updateTime=1770028406706, creator=18614031015, updator=18614031015), WebsiteProps(id=1225151193392001124, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1225150619003039804, code=silenceFlag, value=0, createTime=1770028406713, updateTime=1770028406713, creator=18614031015, updator=18614031015), WebsiteProps(id=1225151193354252382, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1225150619003039804, code=staticResourcePath, value=https://castjournals.cast.org.cn/joweb/cast_kjdb_en_623/, createTime=1770028406704, updateTime=1770028406704, creator=18614031015, updator=18614031015), WebsiteProps(id=1225151193371029601, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1225150619003039804, code=themeColor, value=null, createTime=1770028406708, updateTime=1770028406708, creator=18614031015, updator=18614031015), WebsiteProps(id=1225151193379418210, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1225150619003039804, code=themeStyle, value=null, createTime=1770028406710, updateTime=1770028406710, creator=18614031015, updator=18614031015)])], journalTitle=振动工程学报, weixinUrl=null, journalUrl=http://zdgcxb.csve.org.cn/, iacademicId=null, status=1, seqNo=null, journalTitleEn=Journal of Vibration Engineering, journalPhotoCn=null, journalPhotoEn=null, journalFirstLetter=J, journalRecommend=null, journalNew=null, journalCollection=null, jcrJf=null, cjcrJf=null, jcrJfStr=null, cjcrJfStr=null, submissionFirstDecision=null, sciSubjectClassification=null, casSubjectClassification=null, citeScore=null, totalCitationFrequency=null, icpCode=null, psCode=null, advertisingLicenseCode=null, copyrightInformation=null, country=null, option=, provinceCode=null, provinceName=null, collectFlag=false), detailUrlCn=https://castjournals.cast.org.cn/joweb/zdgcxb/CN/10.16385/j.cnki.issn.1004-4523.202307050, detailUrlEn=https://castjournals.cast.org.cn/joweb/zdgcxb/EN/10.16385/j.cnki.issn.1004-4523.202307050, pdfUrlCn=https://castjournals.cast.org.cn/joweb/zdgcxb/CN/PDF/10.16385/j.cnki.issn.1004-4523.202307050, pdfUrlEn=https://castjournals.cast.org.cn/joweb/zdgcxb/EN/PDF/10.16385/j.cnki.issn.1004-4523.202307050, aliStartDate=null, aliEndDate=null, collectionFlag=false, citedCount=null, citedUrl=null, reference=null)
收藏切换
基于神经常微分方程的机械故障诊断方法
收藏切换
PDF下载
郭彪 1 , 李志农 1, 2
振动工程学报 | 2025,38(8): 1756-1763
收起
收藏切换
振动工程学报 | 2025, 38(8): 1756-1763
基于神经常微分方程的机械故障诊断方法
全屏
郭彪1 , 李志农1, 2
作者信息
  • 1.南昌航空大学无损检测技术教育部重点实验室,江西 南昌 330063
  • 2.汕头大学智能制造技术教育部重点实验室,广东 汕头 515063
  • 郭彪(1998—),男,硕士研究生。E-mail:

通讯作者:

李志农(1966—),男,博士,教授。E-mail:
Mechanical fault diagnosis method based on neural ordinary differential equations
Biao GUO1 , Zhinong LI1, 2
Affiliations
  • 1.Key Laboratory of Nondestructive Testing Ministry of Education,Nanchang Hangkong University,Nanchang 330063,China
  • 2.Key Laboratory of Intelligent Manufacturing Technology (Shantou University),Ministry of Education,Shantou 515063,China
出版时间: 2025-08-10 doi: 10.16385/j.cnki.issn.1004-4523.202307050
文章导航
收藏切换

针对传统的深度学习故障诊断方法中存在架构可解释性差以及盲目堆叠层数导致的参数增加和内存消耗等问题,将神经常微分方程(neural ordinary differential equations,NODE)引入到机械故障诊断中。搭建面向机械故障诊断的神经常微分方程网络架构,利用神经网络参数化隐藏状态的导数代替指定隐藏层的离散序列。通过构建故障数据与故障类型的非线性关系,使用常微分方程求解器(ODE solver)完成对不同故障类别的分类任务,形成一种端对端的故障诊断模式。将该方法应用到机械故障诊断领域,搭建特定的神经常微分方程网络模型,通过故障数据的输入完成对不同故障类别的分类任务。将该模型应用到航空发动机主轴轴承故障诊断中,并与残差网络模型的故障诊断方法进行对比。试验结果表明,在确保准确率不降低的情况下,该方法不仅减少了内存消耗,而且将模型参数数量减少了将近五倍。

故障诊断  /  神经常微分方程  /  动力学系统  /  残差网络

Based on the problems of poor interpretability,as well as parameter increase and memory consumption caused by blind stacking layers in traditional fault diagnosis method based on deep learning,Neural ordinary differential equation (NODE) is introduced into mechanical fault diagnosis,the network structure of NODE for machinery fault diagnosis is constructed. In the constructed structure,the derivatives of the parameterized hidden states of the neural network are used to replace the discrete sequences of the specified hidden layers. By constructing a nonlinear relationship between fault data and fault types,an ordinary differential equation solver (ODE solver) is used to complete the classification of different fault types,and an end-to-end fault diagnosis model is formed. The proposed method is applied to mechanical fault diagnosis to build a specific NODE network model,and the classification task of different fault categories is accomplished through the input of fault data. The constructed model is applied to the fault diagnosis of spindle bearing in the aircraft engine,and compared with the fault diagnosis method based on residual network model. The experimental results show that the constructed model and residual network model have satisfactory accuracy. However,the constructed model not only reduces the memory consumption,but also reduces the number of model parameters by almost five times.

fault diagnosis  /  neural ordinary differential equation  /  dynamics system  /  residual network
郭彪, 李志农. 基于神经常微分方程的机械故障诊断方法. 振动工程学报, 2025 , 38 (8) : 1756 -1763 . DOI: 10.16385/j.cnki.issn.1004-4523.202307050
Biao GUO, Zhinong LI. Mechanical fault diagnosis method based on neural ordinary differential equations[J]. Journal of Vibration Engineering, 2025 , 38 (8) : 1756 -1763 . DOI: 10.16385/j.cnki.issn.1004-4523.202307050
在大数据背景下,机械故障智能诊断的深入研究和应用迎来了新的机遇,特别是基于深度学习的机械故障诊断方法取得了很大的进展。LIU等[1]利用深度神经网络对旋转机械进行故障诊断,并与贝叶斯、支持向量机等算法进行比较。JING等[2]利用深度卷积网络对齿轮箱进行自适应特征提取,并证明其相较于时、频域特征提取更有优势。ZHANG等[3]将深度残差网络应用到滚动轴承故障诊断,有效防止了梯度爆炸和梯度消失,解决了网络退化的问题。时培明等[4]在深度残差网络的基础上结合注意力机制,有效地提高了滚动轴承故障诊断的准确率。刘飞等[5]为了克服现有基于深度学习的滚动轴承故障诊断算法训练参数量大、训练时间长且需要大量训练样本的缺点,提出了一种基于迁移学习(TL)与深度残差网络(residual network,ResNet)的快速故障诊断算法(TL-ResNet)。池福临等[6]采用联合最大平均偏差准则和条件对抗学习域适配网络这两大机制实现了对齐源域和目标域,通过添加软阈值构建深度收缩残差网络提取噪声冗余下的轴承振动数据的特征信息。针对变负荷、变速度与变噪声三种试验设置验证了模型有效性。尚杰[7]针对变转速工况下的滚动轴承故障问题,提出了一种结合同步提取变换和二维残差网络的故障诊断模型,该模型将时频图作为数据集,利用深度残差网络在数据集上进行训练,在噪声干扰下仍能保证诊断准确率。侯召国等[8]提出了一种改进深度残差网络模型(improved deep residual network,IDRN),主要用来解决旋转机械标签样本不足而导致的故障特征提取困难问题。秦国浩等[9]为了减小由于卷积核尺度单一导致的难以充分捕捉不同冲击的频率成分的问题,提出了一种动态宽卷积残差网络(dynamic wide-kernels residual network,DWResNet)轴承故障诊断方法。通过改进网络动态权重加权机制有效提高了在强背景噪声工况下轴承故障诊断的效果。
在这些基于数据驱动的机械故障智能诊断方法中,研究人员经常使用神经网络建立故障诊断模型。但是,随着人们对诊断精度的要求不断提高,使得神经网络的层数不断增加、结构不断深化。很多研究者开始不关注模型本身的计算成本,使得模型的内存成本和网络参数呈线性增长,导致模型难以被优化且易于过度拟合[10],并且将模型应用到现实当中也会变得非常困难。为了增强深度学习模型的可解释性、减少层数堆叠造成的内存消耗且不降低诊断准确率,CHEN等[11]提出残差网络[12](ResNet)可以被解释为离散的常微分方程[13](ordinary differential equations,ODE)的观点,合理地阐明了神经网络与动态系统两者之间的关系。其中,CHEN等[11]在时间连续的前提下,利用常微分方程求解器对网络隐藏状态进行动力学建模,并使用被称为伴随灵敏度的方法[1114]代替机器学习中的反向传递算法。该模型在监督学习、时间序列预测和连续归一化流等问题的解决上表现出在误差控制、内存效率以及自适应计算等方面的优势。基于神经常微分方程的独特优势,本文将神经常微分方程引入到机械故障诊断中,提出了基于神经常微分方程的机械故障诊断方法,为解决现有的智能诊断方法存在的架构可解释性差以及盲目堆叠层数导致的参数增加和内存消耗等问题提供了一种思路。为突出该方法的优越性,本文还将提出的方法与传统的残差网络模型的故障诊断方法进行了对比,试验结果验证了提出方法的有效性。
残差网络(ResNet)作为一种卷积神经网络,用于学习隐藏变量(如xi+1xi)之间的差值。ResNet的表达式如下:
xi+1=xi+fi(xi,θi)
式中,xi为层数i=1,,n时的ResNet网络层的变量;fi为ResNet在第i层使用的神经网络函数;θi为第i层的网络参数。
将神经常微分方程(NODE)作为ResNet的连续化引入[11],并且把NODE表达式中网络层数t作为连续变量,无限细分,就可以写出其微分形式:
dxtdt=f(xt,t,θ)
式中,xt为层数t=1,,n时的变量;f为由可微分的神经网络构成的微分方程;θ为网络中可学习的参数[15]
若想要知道某层的隐藏状态,只需给出其初始状态xt0t0t1就可以利用下式进行积分计算:
xt1=xt0+t0t1f(xt,t,θ)dt
图1展示一个简单的神经常微分方程网络层传递的示例,可视化地说明了NODE如何获取输入变量并通过网络将其转换为输出变量的过程。图1中,每个实线箭头都是网络dxt/dt=f(xt,t)的值,用于查找下一步网络的隐藏层变量,其中网络f为描述一阶ODE dxt/dt的函数,t为网络的深度。使用数值微分方程求解器将输入通过神经网络f描述的向量场,并最终转变为输出变量。在这个过程中,依靠在常微分方程求解器中选择步长,可以控制每一层函数计算的数量。图1中五个箭头相当于具有五个隐藏层的网络。标记为xt的虚线路径是变量通过NODE的轨迹,xtN为NODE的最终输出。由于神经网络的参数θ不随变量在向量场中的传递而改变,为了简便,网络将使用f(xt,t)取代f(xt,t,θ)
以上为NODE的前向传递过程。为了在反向传递中节省内存成本,并且避免引入额外的数值计算误差,采用伴随灵敏度方法,舍弃传统的反向传递算法。其核心思想是采用伴随灵敏度方法取代传统的梯度传递,而不再通过前向传递中的常微分方程求解器。具体过程如下,若将前向计算的损失函数记为L,则整个常微分方程求解器的前向损失为:
L(xt1)=L(xt0+t0t1f(xt,t,θ)dt)
其伴随状态的定义为:
α(t)=Lxt
式中,α(t)表示在变量t下的关于隐藏状态x的伴随状态。
在NODE反向传递的过程中使用伴随灵敏度法,α(t)为损失Lxt的导数。可以在连续时间下通过下式将梯度继续向前传递:
dα(t)dt=-α(t)f(xt,t,θ)x
α(t0)=α(t1)-t1t0α(t)f(xt,t,θ)xtdt
将上式从t1伴随状态到t0伴随状态的计算过程拓展至整个反向传递网络,计算此过程的整个梯度:
dLdθ=t1t0α(t)f(xt,t,θ)θdt
以上为NODE使用伴随灵敏度法完成反向传递的过程,由于此方法不需要保存反向传递过程中产生的导数梯度,只需记录最后一个时间步的隐藏状态,而神经网络需保存导数梯度、权重和偏置等参数来完成导数链式法则的传递,故减少了不必要的内存消耗。该方法之所以可以替代神经网络的反向传递,是在前向传递中使用了神经常微分方程,计算出了每层的微分形式表示的隐藏状态。而且选择不同的常微分方程求解方法,更有利于平衡计算时间和准确率。
基于此,许多神经网络可以被微分方程所替换,利用常微分方程求解器取代各神经元及各层之间复杂的计算过程,避免盲目堆叠层数导致的浪费,可以有效减少参数数量,实现参数共享,显著减少内存成本[16]
由于神经常微分方程可以被视为连续化的残差网络,为了更好地说明其在故障诊断方面的优势,分别建立残差网络和神经常微分方程网络两个模型进行对比。残差网络(ResNet)模型共有三层结构,分别为下采样卷积层、残差网络层和前馈层。如图2所示,其下采样层用来接收输入数据,进而通过设置残差块(ResBlock)中第一个Conv2D层的步幅来提取特征并降低数据的维数。下采样层的输出作为第一个ResBlock的输入,之后依次传递给下一个ResBlock。像这样连接n个ResBlock,最终ResBlock的输出被展平并通过前馈网络,该网络将输出七种分类标签。表1为所用的ResNet架构的基本布局以及每一层输出张量的大小。表2指出架构中使用的ResBlock的构成。ResNet模型的超参数选择如表3所示。
与残差网络模型(图2)相似,神经常微分方程(NODE)模型(图3)也共有三层结构,包括下采样层、神经常微分方程层和前馈层。下采样层同样用来提取特征并降低输入数据的维数。两种模型结构的主要区别在于中间层,使用常微分方程块(ODEblock)代替ResBlock,其输出通过数值常微分方程求解器向前传递轨迹,将离散化的网络变为连续,以微分方程的形式改进了神经网络各层之间的传递方式(t在此过程中不是时间,而是节点网络的深度,f(xt,t)表示任意一点处的梯度)。之后将隐藏状态输入到前馈层,通过前馈网络的展平层和线性层,最后以七种分类标签的形式输出。表4展示了NODE架构的基本布局以及每一层输出张量的大小。NODE模型的超参数选择如表5所示。
试验采用都灵理工大学航空主轴轴承数据[17]进行故障诊断。试验台如图4所示,具体故障数据集如表6所示。选择在负载1000 N,转速200 Hz条件下x方向上采集的数据。7类工况包括正常工况,故障维度分别为150、250和450 μm下的轴承内圈故障以及故障维度分别为150、250和450 μm下的滚动体故障。对每种工况采集的振动信号划分样本,每类工况构造400个样本,共2800个样本,每个样本选取1024个采样点。将总样本数按照4∶1的比例划分训练集和测试集。
图5为5种ODE sovler:RK4 (Runge-Kutta),Bosh3(Bogacki-Shampine),Dopri5(Dormand-Prince),Dopri8[18]和Euler分别训练NODE模型所用时间。图6为五种ODE sovler训练的函数评估次数(number of function evaluations,NFE),NFE越小代表其计算效率与内存效率越高。从图中可以看出,Euler方法训练所用时间和NFE最少,RK4次之。但由于Euler法为一阶数值方法,当步数增多时,误差会因积累而越来越大。RK4为四阶方法,其精度相较于Euler法有很大程度的提高。所以本次试验NODE故障诊断模型中常微分方程求解器选RK4。
ResNet模型和NODE模型训练和测试的结果分别如图78所示。图7(a)8(a)分别展示了两种模型训练集上的损失函数曲线。可以看出损失函数值随着迭代次数的增加都逐渐收敛并趋向于0,反映了模型找到了最优值,并没有陷入过拟合状态[19]图7(b)8(b)展示了两种模型的训练集和测试集的准确率曲线,在训练集上两种模型的准确率都能达到100%。ResNet模型和NODE模型测试集的最终准确率分别为96.61%和98.93%。
表7给出了两种模型在准确率、参数数量和内存占用的对比。
表7中可以看出,NODE模型较ResNet模型在测试集上准确率略有提高,而且通过pytorch框架自带函数,计算ResNet模型所需的参数数量(即各层之间参数+每层的偏差)几乎为NODE模型的6倍,同时NODE模型的内存占用更少,这表明了NODE通过使用常微分方程求解器代替神经网络起到了优化模型的作用。
图9为ResNet故障诊断模型在测试集上的混淆矩阵,共560个样本,误判19个样本。其中1个真实标签为故障维度250 μm的内圈故障和5个真实标签为故障维度150 μm的内圈故障被误判为正常;5个真实标签为故障维度150 μm的内圈故障被误判为故障维度250 μm的内圈故障;2个真实标签为正常、3个故障维度250 μm的内圈故障和3个故障维度250 μm的滚动体故障被误判为故障维度150 μm的内圈故障。
图10为NODE故障诊断模型在测试集上的混淆矩阵,共560个样本,误判6个样本。其中3个真实标签为故障维度150 μm的内圈故障被误判为正常;2个真实标签为正常和1个真实标签为故障维度250 μm的内圈故障被误判为150 μm的内圈故障。
为了进一步观察NODE故障诊断模型的有效性,利用t-分布邻域嵌入(t-distribution stochastic neighbor embedding,t-SNE[20])算法对输出的高维故障特征进行降维,并以散点图的形式在二维平面上进行展示(散点图的坐标轴无实际意义,用P1和P2表示)。使用ResNet模型对测试集进行分类,结果如图11(a)所示。其中正常、故障维度150 μm和250 μm的内圈故障这三个类别之间存在明显的特征重叠,其余四种类别的故障特征之间相互分离。使用NODE模型对测试集进行分类,结果如图11(b)所示,图中七种轴承工况的特征已经聚类明显,除了正常和故障维度150 μm的内圈故障这两个类别中个别存在特征重叠外,其余五种类别故障特征之间相互分离。这也呼应了图10混淆矩阵中正常和故障维度150 μm的内圈故障这两种类别之间存在的误判,直观反映了NODE故障诊断模型相较于ResNet可以更好地对轴承不同工况进行有效识别。
本文从神经网络与动力学系统两者相互联系的角度入手,阐明了可以将神经网络视作常微分方程的观点,使得神经网络中的黑盒模型具备了可解释性。之后为了提高模型的准确率,减少模型参数,将残差网络的中间层替换为常微分方程层,构建了神经常微分方程网络模型。并将该模型引入到机械故障诊断领域。以都灵理工大学航空主轴轴承数据作为试验数据,通过端对端的故障诊断模式,完成了七种工况下轴承故障分类的任务。与残差网络模型进行对比,在测试集上提高了故障识别准确率的情况下,减少了内存成本并将模型参数减小至残差网络模型的六分之一,证明了通过使用常微分方程代替神经网络起到了优化模型的作用。
  • 国家自然科学基金资助项目(52075236)
  • 江西省自然科学基金重点项目(20212ACB202005)
  • 智能制造技术教育部重点实验室(汕头大学)开放课基金资助项目(STME2024002)
  • 广东省普通高校创新团队资助项目(2020KCXTD012)
参考文献 引证文献
排序方式:
[1]
LIU R NYANG B YZIO E,et al.Artificial intelligence for fault diagnosis of rotating machinery:a review[J]. Mechanical Systems and Signal Processing2018,108:33-47.
[2]
JING L YZHAO MLI P,et al.A convolutional neural network based feature learning and fault diagnosis method for the condition monitoring of gearbox[J]. Measurement2017,111:1-10.
[3]
ZHANG WLI XDING Q. Deep residual learning-based fault diagnosis method for rotating machinery[J]. ISA Transactions2019,95:295-305.
[4]
时培明,吴术平,于越,等.基于注意力机制和深度残差网络的滚动轴承故障诊断[J].燕山大学学报2024,48(1):39-47.
SHI PeimingWU ShupingYU Yue,et al.Rolling bearing fault diagnosis based on attention mechanism and depth residual network[J]. Journal of Yanshan University2024,48(1):39-47.
[5]
刘飞,陈仁文,邢凯玲,等.基于迁移学习与深度残差网络的滚动轴承快速故障诊断算法[J].振动与冲击2022,41(3):154-164.
LIU FeiCHEN RenwenXING Kailing,et al.Fast fault diagnosis algorithm for rolling bearing based on transfer learning and deep residual network[J]. Journal of Vibration and Shock2022,41(3):154-164.
[6]
池福临,杨新宇,邵思羽,等.基于深度收缩残差网络的轴承变工况故障诊断[J]. 计算机集成制造系统2023,29(4):1146-1156.
CHI FulinYANG XinyuSHAO Siyu,et al.Bearing fault diagnosis under variable working conditions based on deep residual shrinkage networks[J].Computer Integrated Manufacturing Systems2023,29(4):1146-1156.
[7]
尚杰. 基于深度残差网络的旋转机械故障诊断[D]. 青岛: 青岛理工大学,2021.
SHANG Jie. Fault diagnosis of rotating machinery based on deep residual network[D]. Qingdao: Qingdao University of Technology,2021.
[8]
侯召国,王华伟,周良,等.基于改进深度残差网络的旋转机械故障诊断[J]. 系统工程与电子技术2022,44(6):2051-2059.
HOU ZhaoguoWANG HuaweiZHOU Liang,et al.Fault diagnosis of rotating machinery based on improved deep residual network[J]. Systems Engineering and Electronics2022,44(6):2051-2059.
[9]
秦国浩,张楷,丁昆,等.动态宽卷积残差网络的轴承故障诊断方法[J]. 中国机械工程2023,34(18):2212-2221.
QIN GuohaoZHANG KaiDING Kun,et al.Dynamic wide convolutional residual network for bearing fault diagnosis method[J]. China Mechanical Engineering2023,34(18):2212-2221.
[10]
李亮. 基于神经常微分方程的时序数据分析与预测[D]. 成都: 电子科技大学,2021.
LI Liang. Analyzing and forecasting time-series data via neural ordinary differential equations[D]. Chengdu: University of Electronic Science and Technology of China,2021.
[11]
CHEN R T QRUBANOVA YBETTENCOURT J,et al.Neural ordinary differential equations[C]// Proceedings of the 32nd International Conference on Neural Information Processing Systems. 2018:6572-6583.
[12]
HE K MZHANG X YREN S Q,et al.Deep residual learning for image recognition[C]// Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. 2016:770-778.
[13]
WEINAN E. A proposal on machine learning via dynamical systems[J]. Communications in Mathematics and Statistics2017,5(1):1-11.
[14]
DUPONT EDOUCET ATEH Y W. Augmented neural ODEs[C]// Proceedings of the 33rd International Conference on Neural Information Processing Systems. 2019:3140-3150.
[15]
NORCLIFFE ABODNAR CDAY B,et al.On second order behaviour in augmented neural ODEs[J]. Advances in Neural Information Processing Systems2020,33:5911-5921.
[16]
KIDGER P. On neural differential equations[J]. arXiv preprint arXiv:2022.
[17]
DAGA A PFASANA AMARCHESIELLO S,et al.The Politecnico di Torino rolling bearing test rig:description and analysis of open access data[J]. Mechanical Systems and Signal Processing2019,120:252-273.
[18]
HAIRER ENORSETT S PWANNER G. Solving Ordinary Differential Equations Ⅰ:Nonstiff Problems[M]. 2nd ed. Springer-Verlag,1993.
[19]
李泽东,李志农,王成军. 深度卷积神经网络在轴承多故障复合诊断中应用研究[J]. 南昌航空大学学报(自然科学版)2020,34(1):12-20.
LI ZedongLI ZhinongWANG Chengjun. Application of deep convolution neural network in bearing multi fault diagnosis[J]. Journal of Nanchang Hangkong University (Natural Sciences)2020,34(1):12-20.
[20]
VAN DER MAATEN LHINTON G. Visualizing Data using t-SNE[J]. Journal of Machine Learning Research2008,9:2579-2605.
2025年第38卷第8期
PDF下载
62
26
引用本文
BibTeX
文章信息
doi: 10.16385/j.cnki.issn.1004-4523.202307050
  • 接收时间:2023-07-17
  • 首发时间:2026-02-09
  • 出版时间:2025-08-10
补充材料
相关文章
文章信息
作者
出版历史
  • 收稿日期:2023-07-17
  • 修回日期:2023-10-22
基金
国家自然科学基金资助项目(52075236)
江西省自然科学基金重点项目(20212ACB202005)
智能制造技术教育部重点实验室(汕头大学)开放课基金资助项目(STME2024002)
广东省普通高校创新团队资助项目(2020KCXTD012)
作者信息
    1.南昌航空大学无损检测技术教育部重点实验室,江西 南昌 330063
    2.汕头大学智能制造技术教育部重点实验室,广东 汕头 515063

通讯作者:

李志农(1966—),男,博士,教授。E-mail:
参考文献
分享链接
https://castjournals.cast.org.cn/joweb/zdgcxb/CN/10.16385/j.cnki.issn.1004-4523.202307050
分享至
全文二维码

扫描看全文

引用本文
BibTeX
本文的引用情况
2种不同金属材料的力学参数

Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)

Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏