Article(id=1241784309162513248, tenantId=1146029695717560320, journalId=1241715181215068175, issueId=1241784304989175988, articleNumber=null, orderNo=null, doi=10.6052/1672-6553-2025-050, pmid=null, cstr=null, oa=null, hot=null, price=null, onlineType=0, articleFormat=0, articleType=null, articleTypeStr=null, receivedDate=1745337600000, receivedDateStr=2025-04-23, revisedDate=1747065600000, revisedDateStr=2025-05-13, acceptedDate=null, acceptedDateStr=null, onlineDate=1773994050540, onlineDateStr=2026-03-20, pubDate=null, pubDateStr=null, doiRegisterDate=null, doiRegisterDateStr=null, onlineIssueDate=1773994050540, onlineIssueDateStr=2026-03-20, onlineJustAcceptDate=null, onlineJustAcceptDateStr=null, onlineFirstDate=null, onlineFirstDateStr=null, sourceXml=null, magXml=null, createTime=1773994050540, creator=13701087609, updateTime=1773994050540, updator=13701087609, issue=Issue{id=1241784304989175988, tenantId=1146029695717560320, journalId=1241715181215068175, year='2025', volume='23', issue='10', pageStart='1', pageEnd='96', issueExtLink='null', onlineDate='null', pubDate='null', beforeIssueId=null, nextIssueId=null, price=null, status=1, issueComplete=1, articleOrder=1, issueType=-1, specialIssue=null, createTime=1773994049546, creator=13701087609, updateTime=1773994239413, updator=13701087609, preIssue=null, nextIssue=null, ext={EN=IssueExt(id=1241785101412012589, tenantId=1146029695717560320, journalId=1241715181215068175, issueId=1241784304989175988, language=EN, specialIssueTitle=, coverIllustrator=null, specialIssueEditor=, specialIssueAbout=), CN=IssueExt(id=1241785101412012590, tenantId=1146029695717560320, journalId=1241715181215068175, issueId=1241784304989175988, language=CN, specialIssueTitle=, coverIllustrator=null, specialIssueEditor=, specialIssueAbout=)}, issueFiles=null}, startPage=35, endPage=44, ext={EN=ArticleExt(id=1241784310991229799, articleId=1241784309162513248, tenantId=1146029695717560320, journalId=1241715181215068175, language=EN, title=Optimization of Actuation Configuration in Earthworm-like Robots via Reinforcement Learning, columnId=1241784307421872311, journalTitle=Journal of Dynamics and Control, columnName=Research Articles, runingTitle=null, highlight=null, articleAbstract=

This study presents a reinforcement learning-based intelligent method for optimizing the actuation of configuration multi-segment earthworm-like robots. A dynamic model of the multi-segment robotic system is first established, and the actuator arrangement problem is formulated as a Markov decision process. By designing a multi-discrete action space, computational costs are significantly reduced. A reward function integrating locomotion speed and energy consumption constraints is proposed to effectively balance exploration and exploitation. For actuator-limited conditions, an action masking mechanism enables efficient policy search under hard constraints. Key findings include: (1) Midline-symmetric actuation yields optimal performance under full-drive conditions;(2) A “posterior-priority, centripetal-clustering” distribution pattern emerges under constrained actuation.

, correspAuthors=Shu Zhang, authorNote=null, correspAuthorsNote=null, copyrightStatement=null, copyrightOwner=null, extLink=null, articleAbsUrl=null, sourceXml=null, magXml=null, pdfUrl=null, pdf=null, pdfFileSize=null, pdfExtLink=null, richHtmlUrl=null, mobilePdfUrl=null, reviewReport=null, pdfFirstPage=null, abstractGraph=null, abstractGraphContent=null, abstractVideo=null, citation=null, cebUrl=null, magXmlContent=null, mapNumber=null, authorCompany=null, fund=null, authors=null, authorsList=Yunxiao Yu, Shu Zhang), CN=ArticleExt(id=1241784322743668873, articleId=1241784309162513248, tenantId=1146029695717560320, journalId=1241715181215068175, language=CN, title=基于强化学习的仿蠕虫机器人驱动排布优化研究, columnId=1241784307690307771, journalTitle=动力学与控制学报, columnName=研究论文, runingTitle=null, highlight=null, articleAbstract=

针对多单元仿蠕虫机器人驱动优化问题,本文提出了一种基于强化学习的智能配置方法.首先建立多单元仿蠕虫机器人的动力学模型,并将驱动排布问题形式化为马尔可夫决策过程.通过设计多重离散动作空间,显著降低了计算成本.提出融合运动速度和能耗约束的奖励函数,有效平衡了探索与开发矛盾.针对驱动器受限条件,提出的动作掩蔽机制实现了硬性约束下的高效策略搜索.研究发现:(1)全驱动时中部对称激活最优;(2)约束条件下呈现“后部优先、向心聚集”的排布规律.

, correspAuthors=张舒, authorNote=null, correspAuthorsNote=
E-mail:
, copyrightStatement=null, copyrightOwner=null, extLink=null, articleAbsUrl=null, sourceXml=lHBn6XiBATxxE+7hmewMIg==, magXml=D56YbqR4iWMOHkJxqeAq1g==, pdfUrl=null, pdf=6Op+0tgbSdSMbeoyQCdiUg==, pdfFileSize=1779767, pdfExtLink=null, richHtmlUrl=null, mobilePdfUrl=null, reviewReport=null, pdfFirstPage=null, abstractGraph=SUmzCHW9yBSEra0xM9efyA==, abstractGraphContent=null, abstractVideo=null, citation=null, cebUrl=null, magXmlContent=1LvR2On9gy7yDI5GpK85Nw==, mapNumber=null, authorCompany=null, fund=null, authors=null, authorsList=俞云潇, 张舒)}, authors=[Author(id=1241784324454944920, tenantId=1146029695717560320, journalId=1241715181215068175, articleId=1241784309162513248, orderNo=0, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1241784324584968347, tenantId=1146029695717560320, journalId=1241715181215068175, articleId=1241784309162513248, authorId=1241784324454944920, language=EN, stringName=Yunxiao Yu, firstName=Yunxiao, middleName=null, lastName=Yu, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=School of Aerospace Engineering and Applied Mechanics,Tongji University, Shanghai 200092, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1241784324668854432, tenantId=1146029695717560320, journalId=1241715181215068175, articleId=1241784309162513248, authorId=1241784324454944920, language=CN, stringName=俞云潇, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=同济大学 航空航天与力学学院,上海 200092, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1241784323049853073, tenantId=1146029695717560320, journalId=1241715181215068175, articleId=1241784309162513248, xref=null, ext=[AuthorCompanyExt(id=1241784323058241682, tenantId=1146029695717560320, journalId=1241715181215068175, articleId=1241784309162513248, companyId=1241784323049853073, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=School of Aerospace Engineering and Applied Mechanics,Tongji University, Shanghai 200092, China), AuthorCompanyExt(id=1241784323070824595, tenantId=1146029695717560320, journalId=1241715181215068175, articleId=1241784309162513248, companyId=1241784323049853073, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=同济大学 航空航天与力学学院,上海 200092)])]), Author(id=1241784324815655076, tenantId=1146029695717560320, journalId=1241715181215068175, articleId=1241784309162513248, orderNo=1, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=zhangshu@tongji.edu.cn, emailSecond=null, emailThird=null, correspondingAuthor=1, authorType=1, ext={EN=AuthorExt(id=1241784324912124074, tenantId=1146029695717560320, journalId=1241715181215068175, articleId=1241784309162513248, authorId=1241784324815655076, language=EN, stringName=Shu Zhang, firstName=Shu, middleName=null, lastName=Zhang, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=, address=School of Aerospace Engineering and Applied Mechanics,Tongji University, Shanghai 200092, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1241784325042147502, tenantId=1146029695717560320, journalId=1241715181215068175, articleId=1241784309162513248, authorId=1241784324815655076, language=CN, stringName=张舒, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=, address=同济大学 航空航天与力学学院,上海 200092, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1241784323049853073, tenantId=1146029695717560320, journalId=1241715181215068175, articleId=1241784309162513248, xref=null, ext=[AuthorCompanyExt(id=1241784323058241682, tenantId=1146029695717560320, journalId=1241715181215068175, articleId=1241784309162513248, companyId=1241784323049853073, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=School of Aerospace Engineering and Applied Mechanics,Tongji University, Shanghai 200092, China), AuthorCompanyExt(id=1241784323070824595, tenantId=1146029695717560320, journalId=1241715181215068175, articleId=1241784309162513248, companyId=1241784323049853073, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=同济大学 航空航天与力学学院,上海 200092)])])], keywords=[Keyword(id=1241784325167976627, tenantId=1146029695717560320, journalId=1241715181215068175, articleId=1241784309162513248, language=EN, orderNo=1, keyword=earthworm-like robot), Keyword(id=1241784325268639927, tenantId=1146029695717560320, journalId=1241715181215068175, articleId=1241784309162513248, language=EN, orderNo=2, keyword=actuation optimization), Keyword(id=1241784325440606394, tenantId=1146029695717560320, journalId=1241715181215068175, articleId=1241784309162513248, language=EN, orderNo=3, keyword=reinforcement learning), Keyword(id=1241784325532881085, tenantId=1146029695717560320, journalId=1241715181215068175, articleId=1241784309162513248, language=EN, orderNo=4, keyword=action masking), Keyword(id=1241784325629350079, tenantId=1146029695717560320, journalId=1241715181215068175, articleId=1241784309162513248, language=EN, orderNo=5, keyword=multi-segment system), Keyword(id=1241784325721624771, tenantId=1146029695717560320, journalId=1241715181215068175, articleId=1241784309162513248, language=CN, orderNo=1, keyword=仿蠕虫机器人), Keyword(id=1241784325910368454, tenantId=1146029695717560320, journalId=1241715181215068175, articleId=1241784309162513248, language=CN, orderNo=2, keyword=驱动优化), Keyword(id=1241784326048780490, tenantId=1146029695717560320, journalId=1241715181215068175, articleId=1241784309162513248, language=CN, orderNo=3, keyword=强化学习), Keyword(id=1241784326388519118, tenantId=1146029695717560320, journalId=1241715181215068175, articleId=1241784309162513248, language=CN, orderNo=4, keyword=动作掩码), Keyword(id=1241784326476599507, tenantId=1146029695717560320, journalId=1241715181215068175, articleId=1241784309162513248, language=CN, orderNo=5, keyword=多单元系统)], refs=[Reference(id=1241784331685925162, tenantId=1146029695717560320, journalId=1241715181215068175, articleId=1241784309162513248, doi=null, pmid=null, pmcid=null, year=2020, volume=59, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=[1], rfOrder=0, authorNames=MAEDA K, SHINODA H, TSUMORI F, journalName=Japanese Journal of Applied Physics, refType=null, unstructuredReference=MAEDA KSHINODA HTSUMORI F. Miniaturization of worm-type soft robot actuated by magnetic field [J]. Japanese Journal of Applied Physics202059:SIIL04., articleTitle=Miniaturization of worm-type soft robot actuated by magnetic field, refAbstract=null), Reference(id=1241784331862085932, tenantId=1146029695717560320, journalId=1241715181215068175, articleId=1241784309162513248, doi=null, pmid=null, pmcid=null, year=2013, volume=null, issue=null, pageStart=586, pageEnd=590, url=null, language=null, rfNumber=[2], rfOrder=1, authorNames=CHEN Y H, CHEN Y, WANG J G, journalName=null, refType=null, unstructuredReference=CHEN Y HCHEN YWANG J G. A novel worm drive for rehabilitation robot joint [C]//2013 IEEE 9th International Conference on Mobile Ad-hoc and Sensor Networks. New York:IEEE,2013:586-590., articleTitle=A novel worm drive for rehabilitation robot joint, refAbstract=null), Reference(id=1241784333405589808, tenantId=1146029695717560320, journalId=1241715181215068175, articleId=1241784309162513248, doi=null, pmid=null, pmcid=null, year=2014, volume=null, issue=null, pageStart=848, pageEnd=851, url=null, language=null, rfNumber=[3], rfOrder=2, authorNames=MANWELL T, VÍTEK T, RANZANI T, journalName=null, refType=null, unstructuredReference=MANWELL TVÍTEK TRANZANI Tet al. Elastic mesh braided worm robot for locomotive endoscopy [C]//2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. New York:IEEE,2014:848-851., articleTitle=Elastic mesh braided worm robot for locomotive endoscopy, refAbstract=null), Reference(id=1241784333502058804, tenantId=1146029695717560320, journalId=1241715181215068175, articleId=1241784309162513248, doi=null, pmid=null, pmcid=null, year=2022, volume=114, issue=6, pageStart=3096, pageEnd=3117, url=null, language=null, rfNumber=[4], rfOrder=3, authorNames=BLANCO-CANQUI H, journalName=Agronomy Journal, refType=null, unstructuredReference=BLANCO-CANQUI H. Cover crops and soil ecosystem engineers [J]. Agronomy Journal2022114(6):3096-3117., articleTitle=Cover crops and soil ecosystem engineers, refAbstract=null), Reference(id=1241784333611110708, tenantId=1146029695717560320, journalId=1241715181215068175, articleId=1241784309162513248, doi=null, pmid=null, pmcid=null, year=2020, volume=5, issue=2, pageStart=26, pageEnd=null, url=null, language=null, rfNumber=[5], rfOrder=4, authorNames=WANG Y F, PANDIT P, KANDHARI A, journalName=Biomimetics, refType=null, unstructuredReference=WANG Y FPANDIT PKANDHARI Aet al. Rapidly exploring random tree algorithm-based path planning for worm-like robot [J]. Biomimetics20205(2):26., articleTitle=Rapidly exploring random tree algorithm-based path planning for worm-like robot, refAbstract=null), Reference(id=1241784333762105654, tenantId=1146029695717560320, journalId=1241715181215068175, articleId=1241784309162513248, doi=null, pmid=null, pmcid=null, year=2007, volume=37, issue=3, pageStart=409, pageEnd=413, url=null, language=null, rfNumber=[6], rfOrder=5, authorNames=ZHAO J, ZHANG Y H, ZHU Y H, journalName=Journal of Southeast University. Natural Science Edition, refType=null, unstructuredReference=ZHAO JZHANG Y HZHU Y Het al. Locomotion control of modular self-reconfigurable robot worm-like structure [J]. Journal of Southeast University. Natural Science Edition200737(3):409-413., articleTitle=Locomotion control of modular self-reconfigurable robot worm-like structure, refAbstract=null), Reference(id=1241784333862768952, tenantId=1146029695717560320, journalId=1241715181215068175, articleId=1241784309162513248, doi=null, pmid=null, pmcid=null, year=2019, volume=null, issue=null, pageStart=204, pageEnd=209, url=null, language=null, rfNumber=[7], rfOrder=6, authorNames=XAVIER M S, FLEMING A J, YONG Y K, journalName=null, refType=null, unstructuredReference=XAVIER M SFLEMING A JYONG Y K. Experimental characterisation of hydraulic fiber-reinforced soft actuators for worm-like robots [C]//2019 7th International Conference on Control,Mechatronics and Automation (ICCMA). New York:IEEE,2019:204-209., articleTitle=Experimental characterisation of hydraulic fiber-reinforced soft actuators for worm-like robots, refAbstract=null), Reference(id=1241784334034735418, tenantId=1146029695717560320, journalId=1241715181215068175, articleId=1241784309162513248, doi=null, pmid=null, pmcid=null, year=2018, volume=null, issue=null, pageStart=54, pageEnd=59, url=null, language=null, rfNumber=[8], rfOrder=7, authorNames=MANWELL T, GUO B J, BACK J, journalName=null, refType=null, unstructuredReference=MANWELL TGUO B JBACK Jet al. Bioinspired setae for soft worm robot locomotion [C]//2018 IEEE International Conference on Soft Robotics (RoboSoft). New York:IEEE,2018:54-59., articleTitle=Bioinspired setae for soft worm robot locomotion, refAbstract=null), Reference(id=1241784334156370238, tenantId=1146029695717560320, journalId=1241715181215068175, articleId=1241784309162513248, doi=null, pmid=null, pmcid=null, year=2014, volume=null, issue=null, pageStart=115, pageEnd=119, url=null, language=null, rfNumber=[9], rfOrder=8, authorNames=XU F P, ZHOU Y, ZHAO Z C, journalName=null, refType=null, unstructuredReference=XU F PZHOU YZHAO Z C. Research on walking principle of a worm pipe robot. In:Wang Y,Mechanical science and engineering IV [C]//4th International Conference on Mechanical Science and Technology (ICMSE 2014). Baech,Switzerland:Trans Tech Publications Ltd,2014:115-119., articleTitle=Research on walking principle of a worm pipe robot. In:Wang Y,Mechanical science and engineering IV, refAbstract=null), Reference(id=1241784334252839232, tenantId=1146029695717560320, journalId=1241715181215068175, articleId=1241784309162513248, doi=null, pmid=null, pmcid=null, year=2014, volume=null, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=[10], rfOrder=9, authorNames=ZHANG K T, QIU C, DAI J S, journalName=null, refType=null, unstructuredReference=ZHANG K TQIU CDAI J S. Helical kirigami-inspired centimeter-scale worm robot with shape-memory-alloy actuators [C]//Proceedings of the ASME Design Engineering Technical Conferences and Computers and Information in Engineering Conference (DETC). New York:ASME,2014., articleTitle=Helical kirigami-inspired centimeter-scale worm robot with shape-memory-alloy actuators, refAbstract=null), Reference(id=1241784334374474051, tenantId=1146029695717560320, journalId=1241715181215068175, articleId=1241784309162513248, doi=null, pmid=null, pmcid=null, year=2023, volume=21, issue=12, pageStart=1, pageEnd=4, url=null, language=null, rfNumber=[11], rfOrder=10, authorNames=方虹斌, 彭海军, journalName=动力学与控制学报, refType=null, unstructuredReference=方虹斌,彭海军. 先进机器人中的动力学与控制专刊序[J]. 动力学与控制学报202321(12):1-4., articleTitle=先进机器人中的动力学与控制专刊序, refAbstract=null), Reference(id=1241784334655492420, tenantId=1146029695717560320, journalId=1241715181215068175, articleId=1241784309162513248, doi=null, pmid=null, pmcid=null, year=2023, volume=21, issue=12, pageStart=1, pageEnd=4, url=null, language=null, rfNumber=[11], rfOrder=11, authorNames=FANG H B, PENG H J, journalName=Journal of Dynamics and Control, refType=null, unstructuredReference=FANG H BPENG H J. Preface to the special issue:dynamics and control of advanced robots [J]. Journal of Dynamics and Control202321(12):1-4. (in Chinese), articleTitle=Preface to the special issue:dynamics and control of advanced robots, refAbstract=null), Reference(id=1241784334764544326, tenantId=1146029695717560320, journalId=1241715181215068175, articleId=1241784309162513248, doi=null, pmid=null, pmcid=null, year=2023, volume=21, issue=2, pageStart=1, pageEnd=11, url=null, language=null, rfNumber=[12], rfOrder=12, authorNames=刁斌斌, 徐鉴, 何健锋, journalName=动力学与控制学报, refType=null, unstructuredReference=刁斌斌,徐鉴,何健锋,. 一款仿蚯蚓机器人的纤维驱动特性建模与辨识[J]. 动力学与控制学报202321(2):1-11., articleTitle=一款仿蚯蚓机器人的纤维驱动特性建模与辨识, refAbstract=null), Reference(id=1241784334873596234, tenantId=1146029695717560320, journalId=1241715181215068175, articleId=1241784309162513248, doi=null, pmid=null, pmcid=null, year=2023, volume=21, issue=2, pageStart=1, pageEnd=11, url=null, language=null, rfNumber=[12], rfOrder=13, authorNames=DIAO B B, XU J, HE J F, journalName=Journal of Dynamics and Control, refType=null, unstructuredReference=DIAO B BXU JHE J Fet al. Actuation feature modeling and identification of a fiber-driven earthworm-like robot [J]. Journal of Dynamics and Control202321(2):1-11. (in Chinese), articleTitle=Actuation feature modeling and identification of a fiber-driven earthworm-like robot, refAbstract=null), Reference(id=1241784335016202572, tenantId=1146029695717560320, journalId=1241715181215068175, articleId=1241784309162513248, doi=null, pmid=null, pmcid=null, year=2023, volume=21, issue=1, pageStart=1, pageEnd=17, url=null, language=null, rfNumber=[13], rfOrder=14, authorNames=周柏李, 方虹斌, 徐鉴, journalName=动力学与控制学报, refType=null, unstructuredReference=周柏李,方虹斌,徐鉴. 模块化可重构机器人动力学研究进展[J]. 动力学与控制学报202321(1):1-17., articleTitle=模块化可重构机器人动力学研究进展, refAbstract=null), Reference(id=1241784335121060176, tenantId=1146029695717560320, journalId=1241715181215068175, articleId=1241784309162513248, doi=null, pmid=null, pmcid=null, year=2023, volume=21, issue=1, pageStart=1, pageEnd=17, url=null, language=null, rfNumber=[13], rfOrder=15, authorNames=ZHOU B L, FANG H B, XU J, journalName=Journal of Dynamics and Control, refType=null, unstructuredReference=ZHOU B LFANG H BXU J. Advances in dynamics of modular reconfigurable robots [J]. Journal of Dynamics and Control202321(1):1-17. (in Chinese), articleTitle=Advances in dynamics of modular reconfigurable robots, refAbstract=null), Reference(id=1241784335230112081, tenantId=1146029695717560320, journalId=1241715181215068175, articleId=1241784309162513248, doi=null, pmid=null, pmcid=null, year=2015, volume=35, issue=2, pageStart=153, pageEnd=177, url=null, language=null, rfNumber=[14], rfOrder=16, authorNames=FANG H B, WANG C H, LI S Y, journalName=Multibody System Dynamics, refType=null, unstructuredReference=FANG H BWANG C HLI S Yet al. A comprehensive study on the locomotion characteristics of a metameric earthworm-like robot [J]. Multibody System Dynamics201535(2):153-177., articleTitle=A comprehensive study on the locomotion characteristics of a metameric earthworm-like robot, refAbstract=null), Reference(id=1241784335347552595, tenantId=1146029695717560320, journalId=1241715181215068175, articleId=1241784309162513248, doi=null, pmid=null, pmcid=null, year=2019, volume=32, issue=null, pageStart=null, pageEnd=null, url=null, language=null, rfNumber=[15], rfOrder=17, authorNames=BHOVAD P, KAUFMANN J, LI S Y, journalName=Extreme Mechanics Letters, refType=null, unstructuredReference=BHOVAD PKAUFMANN JLI S Y. Peristaltic locomotion without digital controllers:exploiting multi-stability in origami to coordinate robotic motion [J]. Extreme Mechanics Letters201932:100552., articleTitle=Peristaltic locomotion without digital controllers:exploiting multi-stability in origami to coordinate robotic motion, refAbstract=null), Reference(id=1241784335423050069, tenantId=1146029695717560320, journalId=1241715181215068175, articleId=1241784309162513248, doi=null, pmid=null, pmcid=null, year=2017, volume=8, issue=12, pageStart=364, pageEnd=null, url=null, language=null, rfNumber=[16], rfOrder=18, authorNames=JIANG Z W, XU J, journalName=Micromachines, refType=null, unstructuredReference=JIANG Z WXU J. The optimal locomotion of a self-propelled worm actuated by two square waves [J]. Micromachines20178(12):364., articleTitle=The optimal locomotion of a self-propelled worm actuated by two square waves, refAbstract=null), Reference(id=1241784335561462103, tenantId=1146029695717560320, journalId=1241715181215068175, articleId=1241784309162513248, doi=null, pmid=null, pmcid=null, year=2023, volume=21, issue=10, pageStart=26, pageEnd=33, url=null, language=null, rfNumber=[17], rfOrder=19, authorNames=刘丰瑞, 颜格, 张晓龙, journalName=动力学与控制学报, refType=null, unstructuredReference=刘丰瑞,颜格,张晓龙,. 基于深度强化学习的动基座双自由度系统动力学控制方法[J]. 动力学与控制学报202321(10):26-33., articleTitle=基于深度强化学习的动基座双自由度系统动力学控制方法, refAbstract=null), Reference(id=1241784335666319706, tenantId=1146029695717560320, journalId=1241715181215068175, articleId=1241784309162513248, doi=null, pmid=null, pmcid=null, year=2023, volume=21, issue=10, pageStart=26, pageEnd=33, url=null, language=null, rfNumber=[17], rfOrder=20, authorNames=LIU F R, YAN G, ZHANG X L, journalName=Journal of Dynamics and Control, refType=null, unstructuredReference=LIU F RYAN GZHANG X Let al. Dynamic control method for dual-degree-of-freedom systems with moving base by deep reinforcement learning [J]. Journal of Dynamics and Control202321(10):26-33. (in Chinese), articleTitle=Dynamic control method for dual-degree-of-freedom systems with moving base by deep reinforcement learning, refAbstract=null), Reference(id=1241784335779565917, tenantId=1146029695717560320, journalId=1241715181215068175, articleId=1241784309162513248, doi=null, pmid=null, pmcid=null, year=2023, volume=21, issue=12, pageStart=53, pageEnd=69, url=null, language=null, rfNumber=[18], rfOrder=21, authorNames=柯恺宸, 金士博, 高博扬, journalName=动力学与控制学报, refType=null, unstructuredReference=柯恺宸,金士博,高博扬,. 基于强化学习的机器人多接触交互任务控制[J]. 动力学与控制学报202321(12):53-69., articleTitle=基于强化学习的机器人多接触交互任务控制, refAbstract=null), Reference(id=1241784335863452001, tenantId=1146029695717560320, journalId=1241715181215068175, articleId=1241784309162513248, doi=null, pmid=null, pmcid=null, year=2023, volume=21, issue=12, pageStart=53, pageEnd=69, url=null, language=null, rfNumber=[18], rfOrder=22, authorNames=KE K C, JIN S B, GAO B Y, journalName=Journal of Dynamics and Control, refType=null, unstructuredReference=KE K CJIN S BGAO B Yet al. A survey of robot intelligent control method in contact-rich tasks [J]. Journal of Dynamics and Control202321(12):53-69. (in Chinese), articleTitle=A survey of robot intelligent control method in contact-rich tasks, refAbstract=null), Reference(id=1241784335934755173, tenantId=1146029695717560320, journalId=1241715181215068175, articleId=1241784309162513248, doi=null, pmid=null, pmcid=null, year=2022, volume=43, issue=4, pageStart=791, pageEnd=802, url=null, language=null, rfNumber=[19], rfOrder=23, authorNames=ZHANG G, ZHANG S, journalName=Chinese quarterly of mechanics, refType=null, unstructuredReference=ZHANG GZHANG S. Actuation coordination of the earthworm-like locomotion robot based on dynamic model [J]. Chinese quarterly of mechanics202243(4):791-802., articleTitle=Actuation coordination of the earthworm-like locomotion robot based on dynamic model, refAbstract=null), Reference(id=1241784336006058344, tenantId=1146029695717560320, journalId=1241715181215068175, articleId=1241784309162513248, doi=null, pmid=null, pmcid=null, year=2015, volume=null, issue=null, pageStart=189, pageEnd=196, url=null, language=null, rfNumber=[20], rfOrder=24, authorNames=NIKOLAIDIS S, RAMAKRISHNAN R, GU K R, journalName=null, refType=null, unstructuredReference=NIKOLAIDIS SRAMAKRISHNAN RGU K Ret al. Efficient model learning from joint-action demonstrations for human-robot collaborative tasks [C]//Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction. New York:ACM,2015:189-196., articleTitle=Efficient model learning from joint-action demonstrations for human-robot collaborative tasks, refAbstract=null)], funds=[Fund(id=1241784331375546661, tenantId=1146029695717560320, journalId=1241715181215068175, articleId=1241784309162513248, awardId=12472022, language=EN, fundingSource=National Natural Science Foundation of China(12472022), fundOrder=null, country=null), Fund(id=1241784331560096039, tenantId=1146029695717560320, journalId=1241715181215068175, articleId=1241784309162513248, awardId=12472022, language=CN, fundingSource=国家自然科学基金资助项目(12472022), fundOrder=null, country=null)], companyList=[AuthorCompany(id=1241784323049853073, tenantId=1146029695717560320, journalId=1241715181215068175, articleId=1241784309162513248, xref=null, ext=[AuthorCompanyExt(id=1241784323058241682, tenantId=1146029695717560320, journalId=1241715181215068175, articleId=1241784309162513248, companyId=1241784323049853073, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=School of Aerospace Engineering and Applied Mechanics,Tongji University, Shanghai 200092, China), AuthorCompanyExt(id=1241784323070824595, tenantId=1146029695717560320, journalId=1241715181215068175, articleId=1241784309162513248, companyId=1241784323049853073, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=同济大学 航空航天与力学学院,上海 200092)])], figs=[ArticleFig(id=1241784326665343195, tenantId=1146029695717560320, journalId=1241715181215068175, articleId=1241784309162513248, language=EN, label=Fig.1, caption=Schematic diagram of the multi-segment worm-like robot's mechanical model, figureFileSmall=bkvfW58FQcY7AqVa+qxaxg==, figureFileBig=SUmzCHW9yBSEra0xM9efyA==, tableContent=null), ArticleFig(id=1241784326807949536, tenantId=1146029695717560320, journalId=1241715181215068175, articleId=1241784309162513248, language=CN, label=图1, caption=多单元仿蠕虫机器人力学模型简图, figureFileSmall=bkvfW58FQcY7AqVa+qxaxg==, figureFileBig=SUmzCHW9yBSEra0xM9efyA==, tableContent=null), ArticleFig(id=1241784327038636266, tenantId=1146029695717560320, journalId=1241715181215068175, articleId=1241784309162513248, language=EN, label=Fig.2, caption=Force analysis schematic of the individual robotic segment, figureFileSmall=+tqi9d6hfuTs5yCJlfoi+A==, figureFileBig=AXvbOyuYdRa0kjnOXBY0Gg==, tableContent=null), ArticleFig(id=1241784327256740077, tenantId=1146029695717560320, journalId=1241715181215068175, articleId=1241784309162513248, language=CN, label=图2, caption=单单元受力分析示意图, figureFileSmall=+tqi9d6hfuTs5yCJlfoi+A==, figureFileBig=AXvbOyuYdRa0kjnOXBY0Gg==, tableContent=null), ArticleFig(id=1241784328888324336, tenantId=1146029695717560320, journalId=1241715181215068175, articleId=1241784309162513248, language=EN, label=Fig.3, caption=Neural network architecture design, figureFileSmall=EcywpfHyejXfF96kkFICpw==, figureFileBig=ob/2xDYwImNGv/GLf9pJjQ==, tableContent=null), ArticleFig(id=1241784329005764855, tenantId=1146029695717560320, journalId=1241715181215068175, articleId=1241784309162513248, language=CN, label=图3, caption=神经网络结构设计, figureFileSmall=EcywpfHyejXfF96kkFICpw==, figureFileBig=ob/2xDYwImNGv/GLf9pJjQ==, tableContent=null), ArticleFig(id=1241784329081262329, tenantId=1146029695717560320, journalId=1241715181215068175, articleId=1241784309162513248, language=EN, label=Fig.4, caption=Flowchart of the reinforcement learning algorithm for earthworm-like robots, figureFileSmall=05dGS8gSLym/JEG+5KlczQ==, figureFileBig=tyFsjrqoaKuxcNmdlt9Ljw==, tableContent=null), ArticleFig(id=1241784329194508540, tenantId=1146029695717560320, journalId=1241715181215068175, articleId=1241784309162513248, language=CN, label=图4, caption=仿蠕虫机器人强化学习算法流程图, figureFileSmall=05dGS8gSLym/JEG+5KlczQ==, figureFileBig=tyFsjrqoaKuxcNmdlt9Ljw==, tableContent=null), ArticleFig(id=1241784329383252222, tenantId=1146029695717560320, journalId=1241715181215068175, articleId=1241784309162513248, language=EN, label=Fig.5, caption=Reward vs training iterations diagram, figureFileSmall=LrFT924Fc/iTldYXJh3K6Q==, figureFileBig=LI/Q/yfCxCEO7H4+P59Aug==, tableContent=null), ArticleFig(id=1241784329496498433, tenantId=1146029695717560320, journalId=1241715181215068175, articleId=1241784309162513248, language=CN, label=图5, caption=奖励与迭代步数图, figureFileSmall=LrFT924Fc/iTldYXJh3K6Q==, figureFileBig=LI/Q/yfCxCEO7H4+P59Aug==, tableContent=null), ArticleFig(id=1241784329857208578, tenantId=1146029695717560320, journalId=1241715181215068175, articleId=1241784309162513248, language=EN, label=Fig.6, caption=Activation pattern vs training epochs diagram, figureFileSmall=DnQc276DyRPIyXHgZvt0Dg==, figureFileBig=Aqw87mmZAseqqo7Hc5FgMQ==, tableContent=null), ArticleFig(id=1241784329970454791, tenantId=1146029695717560320, journalId=1241715181215068175, articleId=1241784309162513248, language=CN, label=图6, caption=迭代周期对应排布图, figureFileSmall=DnQc276DyRPIyXHgZvt0Dg==, figureFileBig=Aqw87mmZAseqqo7Hc5FgMQ==, tableContent=null), ArticleFig(id=1241784330310193418, tenantId=1146029695717560320, journalId=1241715181215068175, articleId=1241784309162513248, language=EN, label=Fig.7, caption=Optimal actuator configurations for varying numbers of active drivers, figureFileSmall=EM3QkVERkj3VFQ0l40L+gg==, figureFileBig=AQfbNTnTsT0EYSY2FXxRhg==, tableContent=null), ArticleFig(id=1241784330415051021, tenantId=1146029695717560320, journalId=1241715181215068175, articleId=1241784309162513248, language=CN, label=图7, caption=不同驱动器个数对应的最优排布, figureFileSmall=EM3QkVERkj3VFQ0l40L+gg==, figureFileBig=AQfbNTnTsT0EYSY2FXxRhg==, tableContent=null), ArticleFig(id=1241784330503131409, tenantId=1146029695717560320, journalId=1241715181215068175, articleId=1241784309162513248, language=EN, label=Fig.8, caption=Schematic of action masking in neural networks, figureFileSmall=V/NiOWxRpBQuXB3LNoe2yA==, figureFileBig=UMhvDYccdj09L+13ZNVB1w==, tableContent=null), ArticleFig(id=1241784330729623828, tenantId=1146029695717560320, journalId=1241715181215068175, articleId=1241784309162513248, language=CN, label=图8, caption=神经网络施加动作掩蔽示意图, figureFileSmall=V/NiOWxRpBQuXB3LNoe2yA==, figureFileBig=UMhvDYccdj09L+13ZNVB1w==, tableContent=null), ArticleFig(id=1241784330813509910, tenantId=1146029695717560320, journalId=1241715181215068175, articleId=1241784309162513248, language=EN, label=Fig.9, caption=Optimal actuator configurations under action masking constraints, figureFileSmall=Dcb9wXxLcFvVn1a3xVcQrA==, figureFileBig=DS+RlNQKIejFy0RBuPqHjA==, tableContent=null), ArticleFig(id=1241784330876424472, tenantId=1146029695717560320, journalId=1241715181215068175, articleId=1241784309162513248, language=CN, label=图9, caption=施加动作掩蔽后不同驱动器个数对应的最优排布, figureFileSmall=Dcb9wXxLcFvVn1a3xVcQrA==, figureFileBig=DS+RlNQKIejFy0RBuPqHjA==, tableContent=null), ArticleFig(id=1241784330968699162, tenantId=1146029695717560320, journalId=1241715181215068175, articleId=1241784309162513248, language=EN, label=Table 1, caption=

Parameter configuration for the dynamic environment of earthworm-like robots

, figureFileSmall=null, figureFileBig=null, tableContent=
ParameterValueUnit
L0 0.0385 m
β5-
m 0.07 kg
g9.8 m/s2
k205 N/m
c0.1 N·s/m
μ0.4-
Kp 2043 N/m
Kd158.9N·s/m
), ArticleFig(id=1241784331040002333, tenantId=1146029695717560320, journalId=1241715181215068175, articleId=1241784309162513248, language=CN, label=表1, caption=

仿蠕虫机器人动力学环境参数设置

, figureFileSmall=null, figureFileBig=null, tableContent=
ParameterValueUnit
L0 0.0385 m
β5-
m 0.07 kg
g9.8 m/s2
k205 N/m
c0.1 N·s/m
μ0.4-
Kp 2043 N/m
Kd158.9N·s/m
), ArticleFig(id=1241784331115499809, tenantId=1146029695717560320, journalId=1241715181215068175, articleId=1241784309162513248, language=EN, label=Table 2, caption=

Hyperparameter configuration of the PPO algorithm

, figureFileSmall=null, figureFileBig=null, tableContent=
HyperparameterDescriptionValue
actor_lr Policy learning rate 1×10-3
critic_lr Value learning rate 1×10-2
γDiscount factor 0.98
λGAE parameter 0.95
εPolicy update threshold0.2
), ArticleFig(id=1241784331249717538, tenantId=1146029695717560320, journalId=1241715181215068175, articleId=1241784309162513248, language=CN, label=表2, caption=

PPO算法超参数设置

, figureFileSmall=null, figureFileBig=null, tableContent=
HyperparameterDescriptionValue
actor_lr Policy learning rate 1×10-3
critic_lr Value learning rate 1×10-2
γDiscount factor 0.98
λGAE parameter 0.95
εPolicy update threshold0.2
)], attaches=null, journal=Journal(id=1241715084465061896, delFlag=0, nameCn=动力学与控制学报, nameEn=Journal of Dynamics and Control, nameHistory1=null, nameHistory2=null, issn=1672-6553, eissn=null, cn=43-1409/O3, coden=null, periodic=0, language=CN, oaType=null, ccby=null, superviseOffice=null, ownerOffice=null, pubOffice=null, editorOffice=null, officeType=null, aims=null, clcCode=null, officeProv=null, officeCity=null, officeAddr=null, officeZip=null, officeEmail=null, officePhone=null, editDirector=null, officeDirector=null, officeDirectorPhone=null, officeStaffNum=null, officeEmpNum=null, coverPicUrl=qn3Hi3oxu7PTv/Qq7QAyYQ==, journalPrice=null, startedYear=null, abbrevIsoEn=Journal of Dynamics and Control, journalRemark=null, publicationField=null, createdTime=1773977546090, updatedTime=1773977788003, createdBy=18614031015, updatedBy=13701087609, firstLetterCn=J, firstLetterEn=J, subjectCode=Engineering, subjectName=null, subjectCodeEn=Engineering, subjectNameEn=null, picCn=qn3Hi3oxu7PTv/Qq7QAyYQ==, picEn=S6axTkMnWpvkJAFwIDKuew==, jcr=null, cjcr=null, exts=[JournalExt(id=1241716099209818732, language=CN, name=动力学与控制学报, nameHistory1=null, nameHistory2=null, managedBy=, sponsoredBy=, publishedBy=, editorOffice=, officeProv=null, officeCity=null, officeAddr=, officeZip=, editDirector=, officeDirector=null, officePhone=null, coverPicUrl=null, journalRemark=, submitArticleUrl=null, websiteUrl=, createdTime=1773977788021, updatedTime=1773977788021, createdBy=13701087609, updatedBy=13701087609, submissionGuidelinesUrl=, submissionAuthorUrl=http://dlxykzxb.cnjournals.net/jdc/author/login, submissionEditorUrl=http://dlxykzxb.cnjournals.net/jdc/editor/login, submissionReviewUrl=http://dlxykzxb.cnjournals.net/jdc/reviewer/login, submissionCeEditorUrl=, submissionAeEditorUrl=, option={"copyright":""}), JournalExt(id=1241716099260150381, language=EN, name=Journal of Dynamics and Control, nameHistory1=null, nameHistory2=null, managedBy=, sponsoredBy=, publishedBy=, editorOffice=, officeProv=null, officeCity=null, officeAddr=, officeZip=, editDirector=, officeDirector=null, officePhone=null, coverPicUrl=null, journalRemark=, submitArticleUrl=null, websiteUrl=, createdTime=1773977788033, updatedTime=1773977788033, createdBy=13701087609, updatedBy=13701087609, submissionGuidelinesUrl=, submissionAuthorUrl=http://dlxykzxb.cnjournals.net/jdc/author/login, submissionEditorUrl=http://dlxykzxb.cnjournals.net/jdc/editor/login, submissionReviewUrl=http://dlxykzxb.cnjournals.net/jdc/reviewer/login, submissionCeEditorUrl=, submissionAeEditorUrl=, option={"copyright":""})], databaseList=null, tenantJournalId=1241715181215068175, websiteList=[Website(id=1241716224137154970, webName=null, webTitle=null, webDomain=null, webCopyrigh=null, webIpcNo=null, seoTitle=null, seoKeywords=null, seoDescription=null, tenantJournalId=null, journalId=1241715181215068175, journalNameCn=null, journalNameEn=null, grayFlag=null, tenantId=1146029695717560320, platformId=null, journalGroupId=null, journalGroupNameCn=null, journalGroupNameEn=null, type=1, domain=https://castjournals.cast.org.cn/joweb/dlxykzxb/CN, language=CN, createTime=1773977817806, createBy=18614031015, updateTime=1773977845683, updateBy=18614031015, name=动力学与控制学报-中文, tplId=1146099689490845704, title=动力学与控制学报, delFlag=0, indexPage=/home, props=[WebsiteProps(id=1241716660567069266, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1241716224137154970, code=articleTextType, value=kx, createTime=1773977921859, updateTime=1773977921859, creator=18614031015, updator=18614031015), WebsiteProps(id=1241716660546097743, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1241716224137154970, code=banner, value=null, createTime=1773977921854, updateTime=1773977921854, creator=18614031015, updator=18614031015), WebsiteProps(id=1241716660592235093, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1241716224137154970, code=grayFlag, value=0, createTime=1773977921865, updateTime=1773977921865, creator=18614031015, updator=18614031015), WebsiteProps(id=1241716660533514830, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1241716224137154970, code=logo, value=https://castjournals.cast.org.cn/joweb/dlxykzxb/CN/file/pic?fileId=L9eIHr2ofXjyZPUAgI21Wg==, createTime=1773977921851, updateTime=1773977921851, creator=18614031015, updator=18614031015), WebsiteProps(id=1241716660604818007, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1241716224137154970, code=minRunFlag, value=0, createTime=1773977921868, updateTime=1773977921868, creator=18614031015, updator=18614031015), WebsiteProps(id=1241716660558680657, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1241716224137154970, code=picServerUrl, value=https://castjournals.cast.org.cn/joweb/dlxykzxb/CN/file/pic, createTime=1773977921857, updateTime=1773977921857, creator=18614031015, updator=18614031015), WebsiteProps(id=1241716660596429398, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1241716224137154970, code=silenceFlag, value=0, createTime=1773977921866, updateTime=1773977921866, creator=18614031015, updator=18614031015), WebsiteProps(id=1241716660550292048, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1241716224137154970, code=staticResourcePath, value=https://castjournals.cast.org.cn/joweb/cast_kjdb_cn_619/, createTime=1773977921855, updateTime=1773977921855, creator=18614031015, updator=18614031015), WebsiteProps(id=1241716660575457875, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1241716224137154970, code=themeColor, value=null, createTime=1773977921861, updateTime=1773977921861, creator=18614031015, updator=18614031015), WebsiteProps(id=1241716660583846484, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1241716224137154970, code=themeStyle, value=null, createTime=1773977921863, updateTime=1773977921863, creator=18614031015, updator=18614031015)]), Website(id=1241716224191680923, webName=null, webTitle=null, webDomain=null, webCopyrigh=null, webIpcNo=null, seoTitle=null, seoKeywords=null, seoDescription=null, tenantJournalId=null, journalId=1241715181215068175, journalNameCn=null, journalNameEn=null, grayFlag=null, tenantId=1146029695717560320, platformId=null, journalGroupId=null, journalGroupNameCn=null, journalGroupNameEn=null, type=1, domain=https://castjournals.cast.org.cn/joweb/dlxykzxb/EN, language=EN, createTime=1773977817819, createBy=18614031015, updateTime=1773977864891, updateBy=18614031015, name=动力学与控制学报-英文, tplId=1146101810881728533, title=Journal of Dynamics and Control, delFlag=0, indexPage=/home, props=[WebsiteProps(id=1241716687112826980, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1241716224191680923, code=articleTextType, value=kx, createTime=1773977928188, updateTime=1773977928188, creator=18614031015, updator=18614031015), WebsiteProps(id=1241716687096049761, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1241716224191680923, code=banner, value=null, createTime=1773977928184, updateTime=1773977928184, creator=18614031015, updator=18614031015), WebsiteProps(id=1241716687133798503, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1241716224191680923, code=grayFlag, value=0, createTime=1773977928193, updateTime=1773977928193, creator=18614031015, updator=18614031015), WebsiteProps(id=1241716687091855456, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1241716224191680923, code=logo, value=https://castjournals.cast.org.cn/joweb/dlxykzxb/EN/file/pic?fileId=L9eIHr2ofXjyZPUAgI21Wg==, createTime=1773977928183, updateTime=1773977928183, creator=18614031015, updator=18614031015), WebsiteProps(id=1241716687150575721, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1241716224191680923, code=minRunFlag, value=0, createTime=1773977928197, updateTime=1773977928197, creator=18614031015, updator=18614031015), WebsiteProps(id=1241716687108632675, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1241716224191680923, code=picServerUrl, value=https://castjournals.cast.org.cn/joweb/dlxykzxb/EN/file/pic, createTime=1773977928187, updateTime=1773977928187, creator=18614031015, updator=18614031015), WebsiteProps(id=1241716687137992808, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1241716224191680923, code=silenceFlag, value=0, createTime=1773977928194, updateTime=1773977928194, creator=18614031015, updator=18614031015), WebsiteProps(id=1241716687100244066, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1241716224191680923, code=staticResourcePath, value=https://castjournals.cast.org.cn/joweb/cast_kjdb_en_623/, createTime=1773977928185, updateTime=1773977928185, creator=18614031015, updator=18614031015), WebsiteProps(id=1241716687121215589, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1241716224191680923, code=themeColor, value=null, createTime=1773977928190, updateTime=1773977928190, creator=18614031015, updator=18614031015), WebsiteProps(id=1241716687125409894, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1241716224191680923, code=themeStyle, value=null, createTime=1773977928191, updateTime=1773977928191, creator=18614031015, updator=18614031015)])], journalTitle=动力学与控制学报, weixinUrl=null, journalUrl=http://dlxykzxb.cnjournals.net, iacademicId=null, status=1, seqNo=null, journalTitleEn=Journal of Dynamics and Control, journalPhotoCn=qn3Hi3oxu7PTv/Qq7QAyYQ==, journalPhotoEn=S6axTkMnWpvkJAFwIDKuew==, journalFirstLetter=J, journalRecommend=null, journalNew=null, journalCollection=null, jcrJf=null, cjcrJf=null, jcrJfStr=null, cjcrJfStr=null, submissionFirstDecision=null, sciSubjectClassification=null, casSubjectClassification=null, citeScore=null, totalCitationFrequency=null, icpCode=null, psCode=null, advertisingLicenseCode=null, copyrightInformation=null, country=null, option=, provinceCode=null, provinceName=null, collectFlag=false), detailUrlCn=https://castjournals.cast.org.cn/joweb/dlxykzxb/CN/10.6052/1672-6553-2025-050, detailUrlEn=https://castjournals.cast.org.cn/joweb/dlxykzxb/EN/10.6052/1672-6553-2025-050, pdfUrlCn=https://castjournals.cast.org.cn/joweb/dlxykzxb/CN/PDF/10.6052/1672-6553-2025-050, pdfUrlEn=https://castjournals.cast.org.cn/joweb/dlxykzxb/EN/PDF/10.6052/1672-6553-2025-050, aliStartDate=null, aliEndDate=null, collectionFlag=false, citedCount=null, citedUrl=null, reference=null)
收藏切换
基于强化学习的仿蠕虫机器人驱动排布优化研究
收藏切换
PDF下载
俞云潇 , 张舒
动力学与控制学报 | 研究论文 2025,23(10): 35-44
收起
收藏切换
动力学与控制学报 | 研究论文 2025, 23(10): 35-44
基于强化学习的仿蠕虫机器人驱动排布优化研究
全屏
俞云潇, 张舒
作者信息
  • 同济大学 航空航天与力学学院,上海 200092

通讯作者:

Optimization of Actuation Configuration in Earthworm-like Robots via Reinforcement Learning
Yunxiao Yu, Shu Zhang
Affiliations
  • School of Aerospace Engineering and Applied Mechanics,Tongji University, Shanghai 200092, China
doi: 10.6052/1672-6553-2025-050
文章导航
收藏切换

针对多单元仿蠕虫机器人驱动优化问题,本文提出了一种基于强化学习的智能配置方法.首先建立多单元仿蠕虫机器人的动力学模型,并将驱动排布问题形式化为马尔可夫决策过程.通过设计多重离散动作空间,显著降低了计算成本.提出融合运动速度和能耗约束的奖励函数,有效平衡了探索与开发矛盾.针对驱动器受限条件,提出的动作掩蔽机制实现了硬性约束下的高效策略搜索.研究发现:(1)全驱动时中部对称激活最优;(2)约束条件下呈现“后部优先、向心聚集”的排布规律.

仿蠕虫机器人  /  驱动优化  /  强化学习  /  动作掩码  /  多单元系统

This study presents a reinforcement learning-based intelligent method for optimizing the actuation of configuration multi-segment earthworm-like robots. A dynamic model of the multi-segment robotic system is first established, and the actuator arrangement problem is formulated as a Markov decision process. By designing a multi-discrete action space, computational costs are significantly reduced. A reward function integrating locomotion speed and energy consumption constraints is proposed to effectively balance exploration and exploitation. For actuator-limited conditions, an action masking mechanism enables efficient policy search under hard constraints. Key findings include: (1) Midline-symmetric actuation yields optimal performance under full-drive conditions;(2) A “posterior-priority, centripetal-clustering” distribution pattern emerges under constrained actuation.

earthworm-like robot  /  actuation optimization  /  reinforcement learning  /  action masking  /  multi-segment system
俞云潇, 张舒. 基于强化学习的仿蠕虫机器人驱动排布优化研究. 动力学与控制学报, 2025 , 23 (10) : 35 -44 . DOI: 10.6052/1672-6553-2025-050
Yunxiao Yu, Shu Zhang. Optimization of Actuation Configuration in Earthworm-like Robots via Reinforcement Learning[J]. Journal of Dynamics and Control, 2025 , 23 (10) : 35 -44 . DOI: 10.6052/1672-6553-2025-050
仿生机器人模仿自然界中生物的外部形状、运动原理和行为方式,能从事与生物特点相衬的工作.近年来,蠕虫型生物的蚯蚓由于在平衡可塑性和力量方面的优异表现,逐渐受到了学术界和工业界的关注[1-3].蚯蚓的生理结构主要有三个特点:身体单元的分节、单元内环纵肌肉拮抗协调和刚毛[4].其分节特征使得每个单元都可独立工作,即每个单元的变形不会影响相邻单元的状态.当蚯蚓运动时,每个单元内环向和纵向肌肉交替收缩,不同单元间交替伸长和缩短,这种拮抗协调机制使得蚯蚓形成蠕动波[5,6],此时单元内刚毛交替向外伸出,保持与外界环境的锚固,使得蚯蚓实现向前运动[7].由此,研究人员模仿蚯蚓生物学特征和运动机理开发了仿蠕虫移动机器人,其结构简单、控制性良好、微型化潜力较大,可以通过灵活改变自身形状进行运动,有望满足工业领域对在非结构化和不可预测的环境中进行作业的要求,实现管道的检测与维修、地震废墟探索搜救、灾后地形侦察与信息搜集等[8-13].
对于仿蠕虫移动机器人,不同的研究团队在力学建模、单元及驱动器设计、材料选用等方面都存在差异,所以会针对不同的移动机器人模型选择合适的优化方法来优化系统的运动性能.Fang等[14]以机器人稳态平均速度和正则化平均速度为步态优化目标函数,利用KKT条件求解该问题,得到对应于不同单元数目的最大平均速度和最大正则化平均速度,并归纳出相应最优步态.该团队还针对机器人相位排布模式进行研究,利用对称群理论得到机器人所有可能的对称性相位排布模式,通过优化各种模式得到最优相位差模式.研究发现恒等相位差排布模式,与最优相位排布模式相比,对稳态平均速度影响非常小,但可以实现驱动降维也有利于实验的进行和工程实践.Bhovad等[15]根据Kresling折纸段设计并制作了两单元仿蠕虫折纸机器人,并利用Kresling折纸中的多重稳定性生成只需一个驱动器的驱动循环.研究使用优化算法计算用于该折纸机器人的Kresling设计参数,目标函数为机器人总应变能,设定相关运动学约束,寻找合适的折纸段长度使得总应变能局部最小.最终实现仅由一个驱动模块,来生成确定的变形序列驱动两单元仿蠕虫折纸机器人,实现减少机器人系统中的驱动器数目而不影响机器人运动这一目标.Jiang等[16]利用两个方波驱动仿蠕虫机器人运动,研究机器人运动性能与一些重要参数(波峰距离、波宽等)之间的最佳关系.使用准静态模型描述类蠕虫运动,研究其在一定时间内的稳态平均速度与参数之间的关系.并根据平均速度表达式和运动约束,利用KT条件优化各种参数间的最优关系,后续通过数值方法和实验验证了优化结果的有效性.
当前针对分节式仿蠕虫移动机器人的驱动优化研究主要存在以下几点局限性:首先,现有研究大多聚焦于稳态平均速度或相位协调等单一性能指标的优化;其次,研究对象通常局限于单元数目较少的机器人系统(一般不超过7个单元),对于高维情况下的多单元机器人(如11个单元),特别是在驱动器数量受限条件下的优化问题,相关研究仍较为缺乏;此外,现有研究多着眼于全驱动条件下的移动速度优化,而较少探讨机器人的功能性优化问题,如驱动资源受限场景下的优化配置问题,特别是驱动器部分失效或激活数量受限时的最优排布策略.
值得注意的是,强化学习方法[17,18]在处理此类高维优化问题时具有独特优势.相较于传统启发式算法,强化学习通过深度神经网络的表征能力,能够有效处理高维稀疏搜索空间的问题.具体而言,启发式算法在高维空间中往往面临局部最优解数量激增和样本稀疏性导致的搜索效率低下问题;但强化学习的在线学习特性使其能够动态评估和调整策略,而启发式算法在参数变更时需要重新进行迭代计算,计算成本显著增加.鉴于实际物理实验难以穷尽所有可能的驱动配置方案,本研究采用理论建模与仿真验证相结合的方法:首先建立动力学方程构建仿真环境,如Zhang[19]建立的仿蠕虫机器人多单元动力学模型,进而通过强化学习算法在虚拟环境中实现驱动排布策略的优化.
基于上述分析,本研究重点开展以下工作:首先建立11单元仿蠕虫机器人的动力学模型,并将驱动排布优化问题形式化为马尔可夫决策过程;随后提出基于动作掩蔽机制的约束优化方法,实现受限条件下的最优驱动排布.这一研究框架为解决多单元仿生机器人的驱动优化问题提供了新的思路和方法.
为能使用强化学习算法在虚拟环境中实现驱动排布的优化,本节构建了多单元仿蠕虫机器人的动力学模型.蚯蚓的定向运动依赖于其体节的拮抗变形与各向异性摩擦的协同作用,具体表现为:(1)分节式体节结构——通过环向与纵向肌肉的交替收缩产生拮抗变形;(2)动态摩擦调控——刚毛在体节膨胀时伸出以增大摩擦,收缩时收回以减小摩擦;(3)运动波传导——神经信号控制体节激活的相位滞后,形成沿体长传播的蠕动波.基于此,可以构建出相应物理构型.
图1所示,仿蠕虫机器人由n个同构运动单元串联而成,各单元参数相同,其中质量为m,刚度为k,阻尼为c,原长为L0.每个单元包含集中质量块,相邻单元间通过并联的弹性结构与阻尼器连接,构成拮抗变形结构.驱动器输出的周期性驱动力与弹性元件的恢复力交替作用,使单元产生拮抗变形,并通过接触界面摩擦力的调制,将驱动能量转化为净推进力.为保证蠕动波传导的完整性,系统末端附加质量为m的刚性配重模块.定义xiR为第i个单元质心在全局坐标系下的绝对位移(i=1,2,…,n),附加刚体的绝对位移为xn+1.
对各个单元进行受力分析(如图2所示)并建立机器人的动力学方程,对于第i个单元:
其中,为单元驱动力,且δi=xi-xi-1-L0为弹簧变形量;为第i单元与接触面的摩擦力,且.那么,可以得到n单元仿蠕虫移动机器人的动力学方程组:
为实现类蚯蚓蠕动波的传播,定义第i单元的理想变形函数:
其中,a为单元变形系数,ω为角速度,ϕi为第i个单元的初相位.本文使用恒等相位差控制模式来生成蠕动波,此种模式下,单元间的相位差恒为Δϕ,则ϕi可表示为:
机器人在移动时单元持续与外界接触,我们以库伦干摩擦为基础设计如下摩擦力形式:
其中,μ为摩擦系数,Si表示单元径向变形对摩擦力的影响,上标β为径向变形系数,当β=0时,表示单元的变形不会影响摩擦力的大小.当β>0时,若Si>1,单元膨胀导致受到更大摩擦,若Si<1,单元回缩导致受到更小摩擦.
采用PD控制实现对运动的调控:
其中,Kp为比例系数,Kd为微分系数,eit)和为位移偏差及其导数,Lthe,it)和为第i个单元的理论变形及其导数,Lact,it)和为第i个单元的真实变形及其导数.
仿蠕虫机器人的驱动器排布优化问题可形式化为马尔可夫决策过程<SAPR>,其中S(状态空间)一般表示机器人所有可能的状态,A(动作空间)表示机器人对驱动器排布方式的可能选择,P根据当前状态和动作确定下一个状态的状态转移概率,R(奖励函数)表示采取动作后从环境中获得的奖励.智能体(仿蠕虫机器人)在离散时间步t观测状态stS,执行动作atA后,依据状态转移概率Pst+1|stat)迁移至新状态st+1,并获得即时奖励rt=Rstatst+1).该过程满足马尔可夫性质,即Pst+1|stat=Pst+1|s0a0,…,stat),确保系统动态仅由当前状态-动作对完全决定.接下来,我们将具体定义状态空间S、动作空间A和奖励函数R.
文中状态空间S被构造为包含局部运动特征和全局运动性能的复合观测向量,其数学表达为:
其中,表征11个仿蠕虫运动单元及1个尾部配重刚体的位移与速度,vcom表征机器人的质心速度.这种状态空间设计能够全面捕捉仿蠕虫机器人的局部和全局运动特性,为智能体提供足够的环境信息以学习最优策略.
动作空间被设计为A={0,1}11的多维离散空间,其中每个元素ai∈{0,1}表征第i个驱动器的激活状态,其中0表示休眠,1表示激活.直接枚举11个单元的所有可能驱动器排布将导致动作空间维度呈指数爆炸(211=2048种组合),而本方案通过分解独立决策将维度压缩至11维,有效解决了传统编码方式的维数灾难问题.任意动作向量a=a1a2,…,a11T唯一确定驱动器的空间激活模式,例如当执行动作a=(1,0,1,0,0,1,0,0,1,0,1)T时,第1、3、6、9、11号单元驱动器被激活.
在强化学习框架中,奖励函数的设计对策略优化具有决定性作用.机器人的最终目标是找到使稳态平均速度最大化的最优排布.然而,这一目标奖励具有明显的稀疏性,仅在找到最优排布后才能获得显著反馈.为了缓解稀疏奖励问题,我们设置了两个即时奖励分量,前向速度奖励vt和驱动器数量奖励nt,表示为:
其中,vt表示时间步t的前向速度,nt表示当前激活的驱动器数量,α为速度权重,β为数量权重.本文的奖励设置中,速度奖励的权重α需要相对大以保证移动性能的主导地位,而数量奖励的权重β则应相对较小,主要起到打破局部最优的辅助作用.在后续强化学习训练中,α=10,β=0.33,这种设计使得智能体在初期能够广泛探索不同驱动配置,随着学习深入则逐步聚焦于优化移动性能.
基于上述状态观测空间和问题描述,本文采用标准的Actor-Critic强化学习架构,由策略网络(Actor)和价值网络(Critic)2个核心组件构成.如图3所示,策略网络采用多重离散动作空间输出结构,其架构包含1个共享的特征提取层和11个独立的输出层.特征提取层为单隐藏层全连接结构,输入为25维状态向量,包含机器人各单元的运动状态及整体质心速度,隐藏层包含128个神经元并使用Re LU激活函数.每个输出层对应1个机器人单元,为了后续对算法施加动作掩蔽,输出层处不使用激活函数,直接输出2维原始逻辑值,分别表示该单元驱动器激活和未激活的倾向性.
对于由11个独立二进制决策组成的复合动作at,其联合动作的对数概率[20]可以分解为各维度对数概率的加权平均:
这一动作设计使得强化学习算法能够对每个单元的驱动器状态进行独立决策.通过从各输出层的概率分布中采样,最终组合形成完整的11单元驱动排布方案.
价值网络采用与策略网络相同的特征提取层结构,并与策略网络共享层中参数,包括128个神经元的单隐藏层(ReLU激活).输出层为单神经元线性结构,用于输出状态价值估计以计算优势函数.
本文采用近端策略优化(PPO)算法作为核心训练框架,该算法通过引入信任域约束和重要性采样机制,在保证策略更新稳定性的同时显著提高了样本利用效率.如图4所示,构建了一个闭环的“智能体-动力学环境”交互学习架构,其中智能体通过策略网络生成动作指令,动力学环境反馈状态转移信息,这种紧密耦合的设计特别适用于仿蠕虫机器人这类具有连续状态空间和离散动作空间的复杂控制问题.
与经典强化学习框架不同,本文将仿蠕虫机器人的非线性动力学模型直接整合到环境交互环节中.在每个时间步t,智能体根据当前状态生成动作at∈{0,1}11后,该动作输入至蠕虫动力学模型,通过采用变步长龙格-库塔数值积分方法求解一个时间步长,获得新状态st+1并计算即时奖励Rt.智能体利用这些交互数据进行策略优化,经过充分学习后输出使平均运动速度最大化的最优排布策略,从而完成强化学习的过程.
在终止条件设计方面,本文采用双重最优存储机制:构建个体最优速度池记录当前训练周期内的最佳性能,构建历史最优速度池保存全局最优解.训练过程分为两个阶段:初期鼓励智能体着重探索,直至迭代较长时间步时终止;后期引入双重收敛准则,要求当前策略产生的运动速度需同时超越当前训练周期内的个体最优速度及全局历史最优速度,方可终止训练.
本文基于OpenAI Gym框架搭建了仿蠕虫机器人运动训练环境,使用Pytorch框架实现强化学习.在此仿真环境中,蠕虫机器人将进行直线运动,运动状态受动力学方程控制.在运动过程中,机器人会随着时间步的增加改变单元中驱动器的激活情况,通过强化学习模型评估机器人当前稳态平均速度的优劣并给予相对奖励,目标是使得机器人以最高稳态平均速度移动.仿真中使用的动力学环境参数与PPO算法超参数设置如表1表2所示,其中动力学环境参数主要来源于Zhang等[19]的工作.
对于具有n个单元数的蠕虫机器人来说,对移动性能影响最大的因素是驱动器激活的个数与激活方式,即驱动器的优化排布方式.驱动器排布方式的全局优化结果如图5图6所示.
可以看到,强化学习训练过程展现出显著的阶段性特征.图6显示,训练奖励折线在前15个训练周期呈现明显的探索期特征,随后在15~20个训练周期实现快速提升,最终稳定在高奖励平台期.这一演化过程表明,智能体成功实现了从随机探索到稳定策略的转变.图5展示了训练步数随迭代次数的变化(柱状图),进一步揭示了策略优化的动态特性:在前15个周期,智能体迭代变换排布至最大时间步也难以找到较优解,而在训练中后期(大于20个训练周期),该数值显著降低.这种搜索效率的跃升说明智能体已经有效学习到环境动力学特征与最优排布方式之间的映射关系.
图7的最终排布统计显示,在训练中后期的所有实验中,最优策略均表现为11个驱动器全部激活的状态(出现频率100%).这一发现直接回答了本研究的关键问题:在给定动力学参数条件下(见表1),不添加额外限制条件,最大化仿蠕虫机器人运动速度的最优驱动策略为全驱动器激活模式.该策略的优越性也符合一般物理认知:通过协调所有单元的拮抗变形,实现最大程度的蠕动波传导,同时全激活状态产生的连续推力分布,也有效克服了地面摩擦.
为了探索蠕虫机器人功能化实现的过程中可能出现的驱动资源受限问题,我们限制驱动器的激活个数,探究在一定驱动器激活个数下,机器人具有最大移动速度的驱动排布情况,如图7所示.
在限定驱动器激活数量的条件下,智能体展现出具有明确空间规律的优化策略.强化学习结果表明,最优驱动器排布遵循“中部优先,对称扩展”的原则.当激活单元数小于等于6时,移动速度随激活单元向中部集中而显著提升;当激活单元数大于6时,速度增加趋于平缓,此时系统开始向两端对称扩展激活单元.
为了进一步探究在驱动资源受限条件下的最优排布策略问题,本文提出一种基于动作掩码的约束优化方法.传统基于惩罚函数的方法,如对非法动作施加负奖励的方法,存在两点局限性:其一,无法完全避免智能体探索非法动作空间,导致部分训练周期浪费在无效尝试上;其二,会显著延缓算法收敛速度.为此,本文采用动作掩码机制,来消除非法动作的选取可能性.如图8所示,该方法通过在策略网络的输出层引入可编程动作掩码,实现对动作空间的智能约束:在神经网络输出动作概率分布后,对非法动作进行硬性屏蔽.本文重点考察此类典型约束条件:强制屏蔽中部单元的激活权限,研究对称性被破坏情况下对机器人运动性能的影响.
在技术实现层面,策略网络输出层输出11个独立的二维概率分布,每个分布对应一个驱动单元的激活决策:
其中,代表单元c未激活的概率,代表单元c被激活的概率.
对于指定的掩码单元集合D(如D={6,7},代表单元6和单元7的驱动器将不能被激活),执行以下操作:
随后使用Softmax进行重新归一化,当cD时:
此时,单元c未激活的概率恒为1,可被激活的概率为0,这确保采样时被掩蔽单元只能输出未激活状态,即被掩蔽单元只能输出动作‘0’(驱动器未激活).而由于被掩蔽单元的强制归零,在梯度回传过程中,这些被掩蔽位置的概率分布值恒为常数,从而不会产生任何参数更新信号.
在仿真中,我们分别设置掩码位置从中部向两端延伸,将不同驱动器激活数下的最优排布方式按质心速度进行升序排列,如图9所示.
仿真结果表明,当施加动作掩蔽后,驱动器激活策略呈现显著的空间偏好特征(图9).具体表现为:
(1)后部单元优先激活现象.在屏蔽第6单元(中部)后,当可用驱动器数量小于等于5时(即不足总单元数的一半),最优排布全部集中于机器人后半段(第7~11单元),且激活单元位置呈现向中部靠拢的趋势.这一现象表明后部单元在非对称条件下对移动速度具有更大的贡献.
(2)分段填充规律.当驱动器数量大于5时,系统首先填满后半段可用单元,再向前半段扩展.
(3)中部偏向性.无论在何种掩码条件下,当激活单元数小于当前可用后半单元数时,驱动器始终优先激活最靠近中部的可用单元.
(4)前后段不对称响应.当掩码导致前半段可用单元多于后半段时(如屏蔽6、7单元),最优策略反而转向优先激活前半段单元,但依然保持向中部聚集的特性.这一反直觉现象揭示出:驱动器的空间价值排序为后部单元>前部单元>中部单元(在对称破坏条件下).
上述发现证实,在对称性破坏的驱动配置下,后部单元的激活优先级显著高于前部单元.这一规律可能与仿蠕虫机器人的动力学特性有关:后部单元驱动比前部单元驱动能更有效地形成推力累积.该结论为驱动器激活受限状态下的机器人容错控制提供了重要指导——当部分驱动器失效时,应优先保障后部近中区域的驱动能力.
本文针对多单元仿蠕虫机器人的驱动优化问题,提出了一套基于强化学习的智能驱动配置方法,主要取得以下研究进展:
首先,通过建立11单元仿蠕虫机器人的动力学模型并将其形式化为马尔可夫决策过程,构建了融合动力学模型与强化学习的优化框架.基于该框架的优化研究发现,最大移动速度对应的驱动排布为全驱动器激活模式,符合一般物理认知,验证了算法的有效性.
其次,研究发现驱动器排布优化存在一定的空间规律——在无约束条件下呈现“中部优先,对称扩展”的特征.当激活单元数小于等于6时,运动速度随中部单元激活显著提升;激活单元数大于6时,运动速度的增加随单元激活递减.
最后,在驱动器受限条件下揭示的反直觉现象具有重要科学价值.对称破坏时后部单元激活优先级高于前部;存在“分段填充”的排布序列规律;始终表现出向心聚集特性.这些发现可以说明,后部单元更利于推力累积.
本研究发现的驱动排布规律对仿蠕虫机器人的实际设计具有明确指导意义:针对驱动器布局设计,根据“中部优先,对称扩展”规律,建议将高功率驱动器集中配置在机器人中后部,以最大化推力效率;针对驱动器故障场景,可基于“分段填充”规律调整激活序列——优先保持后部单元激活,再补充中部单元;在能源受限时,采用“向心聚集”策略,即先激活中后部3个核心单元再逐步向两端扩展.
本研究的主要贡献在于:开发了支持动作掩蔽且结合动力学模型的强化学习方法;发现了驱动资源受限下的驱动排布空间优化规律.研究成果不仅为多单元仿生机器人的驱动优化提供了解决方案,更为复杂系统中的资源受限优化问题研究开辟了新思路.
  • 国家自然科学基金资助项目(12472022)
参考文献 引证文献
排序方式:
[1]
MAEDA KSHINODA HTSUMORI F. Miniaturization of worm-type soft robot actuated by magnetic field [J]. Japanese Journal of Applied Physics202059:SIIL04.
[2]
CHEN Y HCHEN YWANG J G. A novel worm drive for rehabilitation robot joint [C]//2013 IEEE 9th International Conference on Mobile Ad-hoc and Sensor Networks. New York:IEEE,2013:586-590.
[3]
MANWELL TVÍTEK TRANZANI Tet al. Elastic mesh braided worm robot for locomotive endoscopy [C]//2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. New York:IEEE,2014:848-851.
[4]
BLANCO-CANQUI H. Cover crops and soil ecosystem engineers [J]. Agronomy Journal2022114(6):3096-3117.
[5]
WANG Y FPANDIT PKANDHARI Aet al. Rapidly exploring random tree algorithm-based path planning for worm-like robot [J]. Biomimetics20205(2):26.
[6]
ZHAO JZHANG Y HZHU Y Het al. Locomotion control of modular self-reconfigurable robot worm-like structure [J]. Journal of Southeast University. Natural Science Edition200737(3):409-413.
[7]
XAVIER M SFLEMING A JYONG Y K. Experimental characterisation of hydraulic fiber-reinforced soft actuators for worm-like robots [C]//2019 7th International Conference on Control,Mechatronics and Automation (ICCMA). New York:IEEE,2019:204-209.
[8]
MANWELL TGUO B JBACK Jet al. Bioinspired setae for soft worm robot locomotion [C]//2018 IEEE International Conference on Soft Robotics (RoboSoft). New York:IEEE,2018:54-59.
[9]
XU F PZHOU YZHAO Z C. Research on walking principle of a worm pipe robot. In:Wang Y,Mechanical science and engineering IV [C]//4th International Conference on Mechanical Science and Technology (ICMSE 2014). Baech,Switzerland:Trans Tech Publications Ltd,2014:115-119.
[10]
ZHANG K TQIU CDAI J S. Helical kirigami-inspired centimeter-scale worm robot with shape-memory-alloy actuators [C]//Proceedings of the ASME Design Engineering Technical Conferences and Computers and Information in Engineering Conference (DETC). New York:ASME,2014.
[11]
方虹斌,彭海军. 先进机器人中的动力学与控制专刊序[J]. 动力学与控制学报202321(12):1-4.
FANG H BPENG H J. Preface to the special issue:dynamics and control of advanced robots [J]. Journal of Dynamics and Control202321(12):1-4. (in Chinese)
[12]
刁斌斌,徐鉴,何健锋,. 一款仿蚯蚓机器人的纤维驱动特性建模与辨识[J]. 动力学与控制学报202321(2):1-11.
DIAO B BXU JHE J Fet al. Actuation feature modeling and identification of a fiber-driven earthworm-like robot [J]. Journal of Dynamics and Control202321(2):1-11. (in Chinese)
[13]
周柏李,方虹斌,徐鉴. 模块化可重构机器人动力学研究进展[J]. 动力学与控制学报202321(1):1-17.
ZHOU B LFANG H BXU J. Advances in dynamics of modular reconfigurable robots [J]. Journal of Dynamics and Control202321(1):1-17. (in Chinese)
[14]
FANG H BWANG C HLI S Yet al. A comprehensive study on the locomotion characteristics of a metameric earthworm-like robot [J]. Multibody System Dynamics201535(2):153-177.
[15]
BHOVAD PKAUFMANN JLI S Y. Peristaltic locomotion without digital controllers:exploiting multi-stability in origami to coordinate robotic motion [J]. Extreme Mechanics Letters201932:100552.
[16]
JIANG Z WXU J. The optimal locomotion of a self-propelled worm actuated by two square waves [J]. Micromachines20178(12):364.
[17]
刘丰瑞,颜格,张晓龙,. 基于深度强化学习的动基座双自由度系统动力学控制方法[J]. 动力学与控制学报202321(10):26-33.
LIU F RYAN GZHANG X Let al. Dynamic control method for dual-degree-of-freedom systems with moving base by deep reinforcement learning [J]. Journal of Dynamics and Control202321(10):26-33. (in Chinese)
[18]
柯恺宸,金士博,高博扬,. 基于强化学习的机器人多接触交互任务控制[J]. 动力学与控制学报202321(12):53-69.
KE K CJIN S BGAO B Yet al. A survey of robot intelligent control method in contact-rich tasks [J]. Journal of Dynamics and Control202321(12):53-69. (in Chinese)
[19]
ZHANG GZHANG S. Actuation coordination of the earthworm-like locomotion robot based on dynamic model [J]. Chinese quarterly of mechanics202243(4):791-802.
[20]
NIKOLAIDIS SRAMAKRISHNAN RGU K Ret al. Efficient model learning from joint-action demonstrations for human-robot collaborative tasks [C]//Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction. New York:ACM,2015:189-196.
2025年第23卷第10期
PDF下载
160
72
引用本文
BibTeX
文章信息
doi: 10.6052/1672-6553-2025-050
  • 接收时间:2025-04-23
  • 首发时间:2026-03-20
补充材料
相关文章
文章信息
作者
出版历史
  • 收稿日期:2025-04-23
  • 修回日期:2025-05-13
基金
National Natural Science Foundation of China(12472022)
国家自然科学基金资助项目(12472022)
作者信息
    同济大学 航空航天与力学学院,上海 200092

通讯作者:

参考文献
分享链接
https://castjournals.cast.org.cn/joweb/dlxykzxb/CN/10.6052/1672-6553-2025-050
分享至
全文二维码

扫描看全文

引用本文
BibTeX
本文的引用情况
2种不同金属材料的力学参数

Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)

Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏