收藏切换
Residual Reinforcement Learning for Autonomous Transluminal Intervention
收藏切换
PDF
Xiang-rong TANG1, Gui-bin BIAN1, 2, Zhen LI2, Rui-chen MA2, *
Science Technology and Engineering | 2025, 25(17) : 7244 - 7251
Less
收藏切换
Science Technology and Engineering | 2025, 25(17): 7244-7251
Papers-Automation and Computational Technology
Residual Reinforcement Learning for Autonomous Transluminal Intervention
Full
Xiang-rong TANG1, Gui-bin BIAN1, 2, Zhen LI2, Rui-chen MA2, *
Affiliations
  • 1 School of Automation, Beijing Information Science and Technology University, Beijing 100192, China
  • 2 Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China
Published: 2025-06-18 doi: 10.12404/j.issn.1671-1815.2404338
Outline
收藏切换

The natural orifice intervention using continuum robots faces challenges such as tortuous and narrow intervention paths, as well as compressive forces exerted by soft tissues in the orifice. To address the issue in the delivery process where existing planning methods struggle to balance multiple control objectives, resulting in difficulty in reaching deeper positions, an autonomous planning scheme based on residual reinforcement learning was proposed. The method enables the autonomous delivery of continuum robots through natural orifices. A feedback deviation model between the delivery posture of the continuum robot and the spatial state of the natural orifice was established to control the posture target during the delivery process. Simultaneously, a Markov model of the overall motion process of the continuum robot was constructed to train the reinforcement learning algorithm. A residual strategy, generated by combining posture feedback control with reinforcement learning control, was used to output the optimal actions for the continuum robot's delivery process. Experiments conducted in a simulated bronchial orifice show that the proposed method converges over 60% faster than existing methods and can plan smooth, collision-free trajectories for the continuum robot's intervention through the orifice, outperforming existing methods in several key metrics.

continuum robot  /  autonomous planning  /  residual strategy  /  transluminal intervention  /  reinforcement learning
Xiang-rong TANG, Gui-bin BIAN, Zhen LI, Rui-chen MA. Residual Reinforcement Learning for Autonomous Transluminal Intervention[J]. Science Technology and Engineering, 2025 , 25 (17) : 7244 -7251 . DOI: 10.12404/j.issn.1671-1815.2404338
Year 2025 volume 25 Issue 17
PDF
235
102
Cite this Article
BibTeX
Article Info
doi: 10.12404/j.issn.1671-1815.2404338
  • Receive Date:2024-06-11
  • Online Date:2025-12-15
  • Published:2025-06-18
Article Data
Affiliations
History
  • Received:2024-06-11
Funding
Affiliations
    1 School of Automation, Beijing Information Science and Technology University, Beijing 100192, China
    2 Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China
References
Share
https://castjournals.cast.org.cn/joweb/kxjsygc/EN/10.12404/j.issn.1671-1815.2404338
Share to
QR

Scan QR to access full text

Cite this article
BibTeX
Citations
表12种不同金属材料的力学参数

Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)

Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏
  • BibTeX
  • EndNote
  • RefWorks
  • TxT