收藏切换
Optimization of Actuation Configuration in Earthworm-like Robots via Reinforcement Learning
收藏切换
PDF
Yunxiao Yu, Shu Zhang
Journal of Dynamics and Control | 2025, 23(10) : 35 - 44
Less
收藏切换
Journal of Dynamics and Control | 2025, 23(10): 35-44
Research Articles
Optimization of Actuation Configuration in Earthworm-like Robots via Reinforcement Learning
Full
Yunxiao Yu, Shu Zhang
Affiliations
  • School of Aerospace Engineering and Applied Mechanics,Tongji University, Shanghai 200092, China
doi: 10.6052/1672-6553-2025-050
Outline
收藏切换

This study presents a reinforcement learning-based intelligent method for optimizing the actuation of configuration multi-segment earthworm-like robots. A dynamic model of the multi-segment robotic system is first established, and the actuator arrangement problem is formulated as a Markov decision process. By designing a multi-discrete action space, computational costs are significantly reduced. A reward function integrating locomotion speed and energy consumption constraints is proposed to effectively balance exploration and exploitation. For actuator-limited conditions, an action masking mechanism enables efficient policy search under hard constraints. Key findings include: (1) Midline-symmetric actuation yields optimal performance under full-drive conditions;(2) A “posterior-priority, centripetal-clustering” distribution pattern emerges under constrained actuation.

earthworm-like robot  /  actuation optimization  /  reinforcement learning  /  action masking  /  multi-segment system
Yunxiao Yu, Shu Zhang. Optimization of Actuation Configuration in Earthworm-like Robots via Reinforcement Learning[J]. Journal of Dynamics and Control, 2025 , 23 (10) : 35 -44 . DOI: 10.6052/1672-6553-2025-050
  • National Natural Science Foundation of China(12472022)
Year 2025 volume 23 Issue 10
PDF
159
72
Cite this Article
BibTeX
Article Info
doi: 10.6052/1672-6553-2025-050
  • Receive Date:2025-04-23
  • Online Date:2026-03-20
Article Data
Affiliations
History
  • Received:2025-04-23
  • Revised:2025-05-13
Funding
National Natural Science Foundation of China(12472022)
Affiliations
    School of Aerospace Engineering and Applied Mechanics,Tongji University, Shanghai 200092, China
References
Share
https://castjournals.cast.org.cn/joweb/dlxykzxb/EN/10.6052/1672-6553-2025-050
Share to
QR

Scan QR to access full text

Cite this article
BibTeX
Citations
表12种不同金属材料的力学参数

Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)

Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏
  • BibTeX
  • EndNote
  • RefWorks
  • TxT