Article(id=1311360863915835634, tenantId=1146029695717560320, journalId=1240618002186551303, issueId=1311360859318870426, articleNumber=null, orderNo=null, doi=10.3969/j.issn.1000-4653.2026.04.005, pmid=null, cstr=null, oa=null, hot=null, price=null, onlineType=0, articleFormat=0, articleType=null, articleTypeStr=null, receivedDate=1765296000000, receivedDateStr=2025-12-10, revisedDate=null, revisedDateStr=null, acceptedDate=null, acceptedDateStr=null, onlineDate=1790582393863, onlineDateStr=2026-09-28, pubDate=1787587200000, pubDateStr=2026-08-25, doiRegisterDate=null, doiRegisterDateStr=null, onlineIssueDate=1790582393863, onlineIssueDateStr=2026-09-28, onlineJustAcceptDate=null, onlineJustAcceptDateStr=null, onlineFirstDate=null, onlineFirstDateStr=null, sourceXml=null, magXml=null, createTime=1790582393863, creator=13701087609, updateTime=1790582393863, updator=13701087609, issue=Issue{id=1311360859318870426, tenantId=1146029695717560320, journalId=1240618002186551303, year='2026', volume='49', issue='4', pageStart='1', pageEnd='185', issueExtLink='null', onlineDate='null', pubDate='1787587200000', pubDateStr='2026-08-25', beforeIssueId=null, nextIssueId=null, price=null, status=1, issueComplete=1, articleOrder=1, issueType=1, specialIssue=null, createTime=1790582392768, creator='13701087609', updateTime=1790583829226, updator='13701087609', preIssue=null, nextIssue=null, articleTotal=null, ext={EN=IssueExt(id=1311366884331716830, tenantId=1146029695717560320, journalId=1240618002186551303, issueId=1311360859318870426, language=EN, specialIssueTitle=, coverIllustrator=null, specialIssueEditor=, specialIssueAbout=), CN=IssueExt(id=1311366884331716831, tenantId=1146029695717560320, journalId=1240618002186551303, issueId=1311360859318870426, language=CN, specialIssueTitle=, coverIllustrator=null, specialIssueEditor=, specialIssueAbout=)}, issueFiles=null, downloadFileDto=null}, startPage=39, endPage=46, ext={EN=ArticleExt(id=1311360864142328051, articleId=1311360863915835634, tenantId=1146029695717560320, journalId=1240618002186551303, language=EN, title=Autonomous navigation method for aids to navigation based on improved proximal policy optimization, columnId=1240655021340160960, journalTitle=Navigation of China, columnName=Intelligent Shipping, runingTitle=null, highlight=null, articleAbstract=

In the busy waters of nearshore port channels, physical Aids to Navigation (AtoN) are highly susceptible to collisions, which may cause structural damage and prevent them from operating normally. To address the research gap in autonomous navigation of AtoN, including the inability of existing methods to achieve autonomous navigation and collision avoidance and their insufficient integration with artificial intelligence technologies for intelligent navigation, this paper proposes an autonomous navigation method for AtoN based on improved Proximal Policy Optimization (PPO) combined with the Velocity Obstacle (VO) algorithm. The PPO algorithm was improved by introducing an offline learning strategy to enhance network update efficiency. By designing the autonomous navigation action space for AtoN, the model can achieve faster convergence. However, the model is prone to falling into local optima during convergence. To avoid this problem, the VO algorithm is incorporated to represent the state space, and a reward function is designed using velocity vectors. On the basis of calculating the distance-based reward function, an additional reward function based on position and velocity information is introduced to improve convergence speed and enable AtoN to adaptively select the optimal velocity in nearshore port channels. To further enhance algorithm robustness, an entropy reward term is added to the PPO algorithm to encourage greater exploration. Experimental results show that, compared with the method without the entropy reward term, the proposed method improves the average navigation step length and average navigation velocity by 9.3% and 10.2%, respectively, while maintaining a model test success rate of over 99%. The proposed method enables a safe operational mode featuring unmanned control, autonomous navigation, and collision avoidance for AtoN. It can reduce the collision damage risk of AtoN in busy waters and lower the costs of manual inspection and maintenance. The study is of significance for accelerating the construction of a modern maritime navigation support system and ensuring maritime navigation safety.

, authors=Delai Xue1, *, Jingpeng Zhu1, Chuanbo Wu2, authorsList=Delai Xue, Jingpeng Zhu, Chuanbo Wu, authorCompany=null, correspAuthors=Delai Xue, authorNote=null, correspAuthorsNote=null, copyrightStatement=null, copyrightOwner=null, extLink=null, articleAbsUrl=null, sourceXml=null, magXml=null, pdfUrl=null, pdf=null, pdfFileSize=null, pdfExtLink=null, richHtmlUrl=null, mobilePdfUrl=null, reviewReport=null, pdfFirstPage=null, abstractGraph=null, abstractGraphContent=null, abstractVideo=null, citation=null, cebUrl=null, magXmlContent=null, mapNumber=null, fund=null), CN=ArticleExt(id=1311360864419152116, articleId=1311360863915835634, tenantId=1146029695717560320, journalId=1240618002186551303, language=CN, title=基于改进近端策略优化的航标自航方法研究, columnId=1240655021528904650, journalTitle=中国航海, columnName=智能航运, runingTitle=null, highlight=null, articleAbstract=

在近海港口航道繁忙水域,海上实体航标极易发生碰撞,导致标体损坏,无法正常运行。为解决现有方案针对航标自航研究领域空白,不能实现自主航行避碰,未能有效结合人工智能技术使其智能化航行工作等问题,提出一种改进近端策略优化并结合速度障碍的航标自航方法。近端策略优化算法采用离线学习方式提高网络更新效率,设计航标自航动作空间,能更快实现模型收敛;但在模型收敛时容易陷入局部最优,为避免模型陷入局部最优,结合速度障碍算法表示状态空间,用速度向量设计奖励函数,使其在计算距离奖励函数基础上,增加基于位置和速度信息的奖励函数,提高收敛速度,并满足航标在近海港口航道中自适应地选择最佳速度;为提高算法鲁棒性,增加熵奖励函数对近端策略优化算法改进,以激励更多探索。试验表明,增加熵奖励函数与未增加相比,在平均航行步长、平均航行速度等指标上分别提升了9.3%、10.2%,且模型测试成功率保持在99%以上。该方法实现了航标无人操控、自主航行及避碰的安全作业模式,降低航标在繁忙水域被碰撞损坏的风险,减少人工巡检和维护成本。对加快构建现代化航海保障体系、保障海上航行安全具有重要战略意义。

, authors=薛德来1, *, 朱景鹏1, 吴川博2, authorsList=薛德来, 朱景鹏, 吴川博, authorCompany=null, correspAuthors=薛德来, authorNote=null, correspAuthorsNote=
薛德来(1999—),男,助理工程师,研究方向为航标技术管理,(E-mail)
, copyrightStatement=null, copyrightOwner=null, extLink=null, articleAbsUrl=null, sourceXml=5/IheGpu2ISAFEQyGF8rTw==, magXml=Uu8l8fzOVB2oqlX1IuOxhg==, pdfUrl=null, pdf=xckeyBT/MhH9jDmh8xf6sw==, pdfFileSize=2353489, pdfExtLink=null, richHtmlUrl=null, mobilePdfUrl=null, reviewReport=null, pdfFirstPage=null, abstractGraph=null, abstractGraphContent=null, abstractVideo=null, citation=null, cebUrl=null, magXmlContent=TJpEZa7Ux1EKwtTkvz1Uzw==, mapNumber=null, fund=null)}, authors=[Author(id=1311360866268840188, tenantId=1146029695717560320, journalId=1240618002186551303, articleId=1311360863915835634, orderNo=0, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=2035822746@qq.com, emailSecond=null, emailThird=null, correspondingAuthor=1, authorType=1, ext={EN=AuthorExt(id=1311360866356920574, tenantId=1146029695717560320, journalId=1240618002186551303, articleId=1311360863915835634, authorId=1311360866268840188, language=EN, stringName=Delai Xue, firstName=Delai, middleName=null, lastName=Xue, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, *, address=1.Yantai AtoN Division, Northern Navigation Service Center, Maritime Safety Administration, People's Republic of China, Yantai 264000, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1311360866432418047, tenantId=1146029695717560320, journalId=1240618002186551303, articleId=1311360863915835634, authorId=1311360866268840188, language=CN, stringName=薛德来, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, *, address=1.交通运输部北海航海保障中心 烟台航标处,山东 烟台 264000, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1311360864607895797, tenantId=1146029695717560320, journalId=1240618002186551303, articleId=1311360863915835634, xref=1., ext=[AuthorCompanyExt(id=1311360864616284406, tenantId=1146029695717560320, journalId=1240618002186551303, articleId=1311360863915835634, companyId=1311360864607895797, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1.Yantai AtoN Division, Northern Navigation Service Center, Maritime Safety Administration, People's Republic of China, Yantai 264000, China), AuthorCompanyExt(id=1311360864624673015, tenantId=1146029695717560320, journalId=1240618002186551303, articleId=1311360863915835634, companyId=1311360864607895797, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1.交通运输部北海航海保障中心 烟台航标处,山东 烟台 264000)])]), Author(id=1311360866524692737, tenantId=1146029695717560320, journalId=1240618002186551303, articleId=1311360863915835634, orderNo=1, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1311360866600190211, tenantId=1146029695717560320, journalId=1240618002186551303, articleId=1311360863915835634, authorId=1311360866524692737, language=EN, stringName=Jingpeng Zhu, firstName=Jingpeng, middleName=null, lastName=Zhu, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, address=1.Yantai AtoN Division, Northern Navigation Service Center, Maritime Safety Administration, People's Republic of China, Yantai 264000, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1311360866679881988, tenantId=1146029695717560320, journalId=1240618002186551303, articleId=1311360863915835634, authorId=1311360866524692737, language=CN, stringName=朱景鹏, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, address=1.交通运输部北海航海保障中心 烟台航标处,山东 烟台 264000, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1311360864607895797, tenantId=1146029695717560320, journalId=1240618002186551303, articleId=1311360863915835634, xref=1., ext=[AuthorCompanyExt(id=1311360864616284406, tenantId=1146029695717560320, journalId=1240618002186551303, articleId=1311360863915835634, companyId=1311360864607895797, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1.Yantai AtoN Division, Northern Navigation Service Center, Maritime Safety Administration, People's Republic of China, Yantai 264000, China), AuthorCompanyExt(id=1311360864624673015, tenantId=1146029695717560320, journalId=1240618002186551303, articleId=1311360863915835634, companyId=1311360864607895797, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1.交通运输部北海航海保障中心 烟台航标处,山东 烟台 264000)])]), Author(id=1311360866742796550, tenantId=1146029695717560320, journalId=1240618002186551303, articleId=1311360863915835634, orderNo=2, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1311360866826682632, tenantId=1146029695717560320, journalId=1240618002186551303, articleId=1311360863915835634, authorId=1311360866742796550, language=EN, stringName=Chuanbo Wu, firstName=Chuanbo, middleName=null, lastName=Wu, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=2, address=2.School of Mechanical Engineering, Hebei University of Science and Technology, Shijiazhuang 050018, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1311360866897985801, tenantId=1146029695717560320, journalId=1240618002186551303, articleId=1311360863915835634, authorId=1311360866742796550, language=CN, stringName=吴川博, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=2, address=2.河北科技大学 机械工程学院,河北 石家庄 050018, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1311360864700170488, tenantId=1146029695717560320, journalId=1240618002186551303, articleId=1311360863915835634, xref=2., ext=[AuthorCompanyExt(id=1311360864712753401, tenantId=1146029695717560320, journalId=1240618002186551303, articleId=1311360863915835634, companyId=1311360864700170488, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2.School of Mechanical Engineering, Hebei University of Science and Technology, Shijiazhuang 050018, China), AuthorCompanyExt(id=1311360864721142010, tenantId=1146029695717560320, journalId=1240618002186551303, articleId=1311360863915835634, companyId=1311360864700170488, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2.河北科技大学 机械工程学院,河北 石家庄 050018)])])], keywords=[Keyword(id=1311360866998649098, tenantId=1146029695717560320, journalId=1240618002186551303, articleId=1311360863915835634, language=EN, orderNo=1, keyword=navigation safety), Keyword(id=1311360867069952267, tenantId=1146029695717560320, journalId=1240618002186551303, articleId=1311360863915835634, language=EN, orderNo=2, keyword=autonomous navigation of AtoN), Keyword(id=1311360867153838348, tenantId=1146029695717560320, journalId=1240618002186551303, articleId=1311360863915835634, language=EN, orderNo=3, keyword=improved proximal policy optimization), Keyword(id=1311360867233530125, tenantId=1146029695717560320, journalId=1240618002186551303, articleId=1311360863915835634, language=EN, orderNo=4, keyword=entropy reward), Keyword(id=1311360867325804814, tenantId=1146029695717560320, journalId=1240618002186551303, articleId=1311360863915835634, language=EN, orderNo=5, keyword=AtoN collision avoidance), Keyword(id=1311360867426468111, tenantId=1146029695717560320, journalId=1240618002186551303, articleId=1311360863915835634, language=EN, orderNo=6, keyword=AtoN protection), Keyword(id=1311360867497771280, tenantId=1146029695717560320, journalId=1240618002186551303, articleId=1311360863915835634, language=CN, orderNo=1, keyword=航行安全), Keyword(id=1311360867581657361, tenantId=1146029695717560320, journalId=1240618002186551303, articleId=1311360863915835634, language=CN, orderNo=2, keyword=航标自主航行), Keyword(id=1311360867665543442, tenantId=1146029695717560320, journalId=1240618002186551303, articleId=1311360863915835634, language=CN, orderNo=3, keyword=改进近端策略优化), Keyword(id=1311360867741040915, tenantId=1146029695717560320, journalId=1240618002186551303, articleId=1311360863915835634, language=CN, orderNo=4, keyword=熵奖励), Keyword(id=1311360867820732692, tenantId=1146029695717560320, journalId=1240618002186551303, articleId=1311360863915835634, language=CN, orderNo=5, keyword=航标避碰), Keyword(id=1311360867908813077, tenantId=1146029695717560320, journalId=1240618002186551303, articleId=1311360863915835634, language=CN, orderNo=6, keyword=航标保护)], refs=null, funds=[Fund(id=1311360868017864982, tenantId=1146029695717560320, journalId=1240618002186551303, articleId=1311360863915835634, awardId=E2026208041, language=CN, fundingSource=河北省自然科学基金青年项目(E2026208041), fundOrder=null, country=null), Fund(id=1311360868084973847, tenantId=1146029695717560320, journalId=1240618002186551303, articleId=1311360863915835634, awardId=BJ2026336, language=CN, fundingSource=河北省高等学校科学研究青年拔尖人才项目(BJ2026336), fundOrder=null, country=null)], companyList=[AuthorCompany(id=1311360864607895797, tenantId=1146029695717560320, journalId=1240618002186551303, articleId=1311360863915835634, xref=1., ext=[AuthorCompanyExt(id=1311360864616284406, tenantId=1146029695717560320, journalId=1240618002186551303, articleId=1311360863915835634, companyId=1311360864607895797, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1.Yantai AtoN Division, Northern Navigation Service Center, Maritime Safety Administration, People's Republic of China, Yantai 264000, China), AuthorCompanyExt(id=1311360864624673015, tenantId=1146029695717560320, journalId=1240618002186551303, articleId=1311360863915835634, companyId=1311360864607895797, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1.交通运输部北海航海保障中心 烟台航标处,山东 烟台 264000)]), AuthorCompany(id=1311360864700170488, tenantId=1146029695717560320, journalId=1240618002186551303, articleId=1311360863915835634, xref=2., ext=[AuthorCompanyExt(id=1311360864712753401, tenantId=1146029695717560320, journalId=1240618002186551303, articleId=1311360863915835634, companyId=1311360864700170488, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2.School of Mechanical Engineering, Hebei University of Science and Technology, Shijiazhuang 050018, China), AuthorCompanyExt(id=1311360864721142010, tenantId=1146029695717560320, journalId=1240618002186551303, articleId=1311360863915835634, companyId=1311360864700170488, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2.河北科技大学 机械工程学院,河北 石家庄 050018)])], figs=null, attaches=null, journal=Journal(id=1240617866001694726, delFlag=0, nameCn=中国航海, nameEn=Navigation of China, nameHistory1=null, nameHistory2=null, issn=1000-4653, eissn=null, cn=10-1741/U, coden=null, periodic=1, language=CN, oaType=null, ccby=null, superviseOffice=null, ownerOffice=null, pubOffice=null, editorOffice=null, officeType=null, aims=null, clcCode=null, officeProv=null, officeCity=null, officeAddr=null, officeZip=null, officeEmail=null, officePhone=null, editDirector=null, officeDirector=null, officeDirectorPhone=null, officeStaffNum=null, officeEmpNum=null, coverPicUrl=noZCpe+7WzqFjMsPMw3Ylg==, journalPrice=null, startedYear=null, abbrevIsoEn=Navigation of China, journalRemark=null, publicationField=null, createdTime=1773715948823, updatedTime=1784019364868, createdBy=18614031015, updatedBy=13041195026, firstLetterCn=Z, firstLetterEn=Z, subjectCode=Engineering, subjectName=null, subjectCodeEn=Engineering, subjectNameEn=null, picCn=noZCpe+7WzqFjMsPMw3Ylg==, picEn=h3SZYo8W+nhAJz8ZlQjXpw==, jcr=null, cjcr=null, exts=[JournalExt(id=1283833526164361615, language=CN, name=中国航海, nameHistory1=null, nameHistory2=null, managedBy=, sponsoredBy=, publishedBy=, editorOffice=, officeProv=null, officeCity=null, officeAddr=, officeZip=, editDirector=, officeDirector=null, officePhone=null, coverPicUrl=null, journalRemark=, submitArticleUrl=null, websiteUrl=, createdTime=1784019365111, updatedTime=1784019365111, createdBy=13041195026, updatedBy=13041195026, submissionGuidelinesUrl=, submissionAuthorUrl=https://zghhauthor.cast.org.cn/webm, submissionEditorUrl=https://zghheditor.cast.org.cn/webm, submissionReviewUrl=https://zghhauthor.cast.org.cn/webm, submissionCeEditorUrl=, submissionAeEditorUrl=, option={"copyright":""}), JournalExt(id=1283833526218887568, language=EN, name=Navigation of China, nameHistory1=null, nameHistory2=null, managedBy=, sponsoredBy=, publishedBy=, editorOffice=, officeProv=null, officeCity=null, officeAddr=, officeZip=, editDirector=, officeDirector=null, officePhone=null, coverPicUrl=null, journalRemark=, submitArticleUrl=null, websiteUrl=, createdTime=1784019365124, updatedTime=1784019365124, createdBy=13041195026, updatedBy=13041195026, submissionGuidelinesUrl=, submissionAuthorUrl=http://hhxhbjb.cinnet.cn/authorLogOn.action, submissionEditorUrl=http://hhxhbjb.cinnet.cn/editorLogOn.action, submissionReviewUrl=http://hhxhbjb.cinnet.cn/expertLogOn.action, submissionCeEditorUrl=, submissionAeEditorUrl=, option={"copyright":""})], databaseList=null, tenantJournalId=1240618002186551303, websiteList=[Website(id=1240619203443618380, webName=null, webTitle=null, webDomain=null, webCopyrigh=null, webIpcNo=null, seoTitle=null, seoKeywords=null, seoDescription=null, tenantJournalId=null, journalId=1240618002186551303, journalNameCn=null, journalNameEn=null, grayFlag=null, tenantId=1146029695717560320, platformId=null, journalGroupId=null, journalGroupNameCn=null, journalGroupNameEn=null, type=1, domain=https://castjournals.cast.org.cn/joweb/zghh/CN, language=CN, createTime=1773716267691, createBy=18614031015, updateTime=1773716289156, updateBy=18614031015, name=中国航海-中文, tplId=1146099689490845704, title=中国航海, delFlag=0, indexPage=/home, props=[WebsiteProps(id=1240620222206505565, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1240619203443618380, code=articleTextType, value=kx, createTime=1773716510583, updateTime=1773716510583, creator=18614031015, updator=18614031015), WebsiteProps(id=1240620222185534042, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1240619203443618380, code=banner, value=null, createTime=1773716510578, updateTime=1773716510578, creator=18614031015, updator=18614031015), WebsiteProps(id=1240620222223282784, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1240619203443618380, code=grayFlag, value=0, createTime=1773716510587, updateTime=1773716510587, creator=18614031015, updator=18614031015), WebsiteProps(id=1240620222177145433, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1240619203443618380, code=logo, value=https://castjournals.cast.org.cn/joweb/zghh/CN/file/pic?fileId=KvlDOS/lCoEQEn0ia9k/vw==, createTime=1773716510576, updateTime=1773716510576, creator=18614031015, updator=18614031015), WebsiteProps(id=1240620222244254306, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1240619203443618380, code=minRunFlag, value=0, createTime=1773716510592, updateTime=1773716510592, creator=18614031015, updator=18614031015), WebsiteProps(id=1240620222198116956, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1240619203443618380, code=picServerUrl, value=https://castjournals.cast.org.cn/joweb/zghh/CN/file/pic, createTime=1773716510581, updateTime=1773716510581, creator=18614031015, updator=18614031015), WebsiteProps(id=1240620222235865697, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1240619203443618380, code=silenceFlag, value=0, createTime=1773716510590, updateTime=1773716510590, creator=18614031015, updator=18614031015), WebsiteProps(id=1240620222189728347, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1240619203443618380, code=staticResourcePath, value=https://castjournals.cast.org.cn/joweb/cast_kjdb_cn_619/, createTime=1773716510579, updateTime=1773716510579, creator=18614031015, updator=18614031015), WebsiteProps(id=1240620222210699870, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1240619203443618380, code=themeColor, value=null, createTime=1773716510584, updateTime=1773716510584, creator=18614031015, updator=18614031015), WebsiteProps(id=1240620222219088479, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1240619203443618380, code=themeStyle, value=null, createTime=1773716510586, updateTime=1773716510586, creator=18614031015, updator=18614031015)]), Website(id=1240619203519115854, webName=null, webTitle=null, webDomain=null, webCopyrigh=null, webIpcNo=null, seoTitle=null, seoKeywords=null, seoDescription=null, tenantJournalId=null, journalId=1240618002186551303, journalNameCn=null, journalNameEn=null, grayFlag=null, tenantId=1146029695717560320, platformId=null, journalGroupId=null, journalGroupNameCn=null, journalGroupNameEn=null, type=1, domain=https://castjournals.cast.org.cn/joweb/zghh/EN, language=EN, createTime=1773716267709, createBy=18614031015, updateTime=1773716307444, updateBy=18614031015, name=中国航海-英文, tplId=1146101810881728533, title=Navigation of China, delFlag=0, indexPage=/home, props=[WebsiteProps(id=1240620320386765737, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1240619203519115854, code=articleTextType, value=kx, createTime=1773716533991, updateTime=1773716533991, creator=18614031015, updator=18614031015), WebsiteProps(id=1240620320361599910, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1240619203519115854, code=banner, value=null, createTime=1773716533985, updateTime=1773716533985, creator=18614031015, updator=18614031015), WebsiteProps(id=1240620320411931564, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1240619203519115854, code=grayFlag, value=0, createTime=1773716533997, updateTime=1773716533997, creator=18614031015, updator=18614031015), WebsiteProps(id=1240620320353211301, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1240619203519115854, code=logo, value=https://castjournals.cast.org.cn/joweb/zghh/EN/file/pic?fileId=KvlDOS/lCoEQEn0ia9k/vw==, createTime=1773716533983, updateTime=1773716533983, creator=18614031015, updator=18614031015), WebsiteProps(id=1240620320424514478, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1240619203519115854, code=minRunFlag, value=0, createTime=1773716534000, updateTime=1773716534000, creator=18614031015, updator=18614031015), WebsiteProps(id=1240620320378377128, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1240619203519115854, code=picServerUrl, value=https://castjournals.cast.org.cn/joweb/zghh/EN/file/pic, createTime=1773716533989, updateTime=1773716533989, creator=18614031015, updator=18614031015), WebsiteProps(id=1240620320420320173, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1240619203519115854, code=silenceFlag, value=0, createTime=1773716533999, updateTime=1773716533999, creator=18614031015, updator=18614031015), WebsiteProps(id=1240620320369988519, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1240619203519115854, code=staticResourcePath, value=https://castjournals.cast.org.cn/joweb/cast_kjdb_en_623/, createTime=1773716533987, updateTime=1773716533987, creator=18614031015, updator=18614031015), WebsiteProps(id=1240620320395154346, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1240619203519115854, code=themeColor, value=null, createTime=1773716533993, updateTime=1773716533993, creator=18614031015, updator=18614031015), WebsiteProps(id=1240620320403542955, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1240619203519115854, code=themeStyle, value=null, createTime=1773716533995, updateTime=1773716533995, creator=18614031015, updator=18614031015)])], journalTitle=中国航海, weixinUrl=null, journalUrl=https://zghh.cinnet.cn/, iacademicId=null, status=1, seqNo=null, journalTitleEn=Navigation of China, journalPhotoCn=noZCpe+7WzqFjMsPMw3Ylg==, journalPhotoEn=h3SZYo8W+nhAJz8ZlQjXpw==, journalFirstLetter=Z, journalRecommend=null, journalNew=null, journalCollection=null, jcrJf=null, cjcrJf=null, jcrJfStr=null, cjcrJfStr=null, submissionFirstDecision=null, sciSubjectClassification=null, casSubjectClassification=null, citeScore=null, totalCitationFrequency=null, icpCode=null, psCode=null, advertisingLicenseCode=null, copyrightInformation=null, country=null, option=, provinceCode=null, provinceName=null, collectFlag=false, interPubPlatform=, interPubPlatformUrl=null), detailUrlCn=https://castjournals.cast.org.cn/joweb/zghh/CN/10.3969/j.issn.1000-4653.2026.04.005, detailUrlEn=https://castjournals.cast.org.cn/joweb/zghh/EN/10.3969/j.issn.1000-4653.2026.04.005, pdfUrlCn=https://castjournals.cast.org.cn/joweb/zghh/CN/PDF/10.3969/j.issn.1000-4653.2026.04.005, pdfUrlEn=https://castjournals.cast.org.cn/joweb/zghh/EN/PDF/10.3969/j.issn.1000-4653.2026.04.005, aliStartDate=0, aliEndDate=0, collectionFlag=false, citedCount=null, citedUrl=null, previewStatus=0, delFlag=0, hasFullText=0, orderTime=1787587200000, fullTextJson=null, articleText=null, reference=null)
收藏切换
基于改进近端策略优化的航标自航方法研究
收藏切换
PDF下载
薛德来 1, * , 朱景鹏 1 , 吴川博 2
中国航海 | 智能航运 2026,49(4): 39-46
收起
收藏切换
中国航海 |智能航运 2026 , 49 (4) : 39 -46
基于改进近端策略优化的航标自航方法研究
全屏
[Author(id=1311360866268840188, tenantId=1146029695717560320, journalId=1240618002186551303, articleId=1311360863915835634, orderNo=0, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=2035822746@qq.com, emailSecond=null, emailThird=null, correspondingAuthor=1, authorType=1, ext={EN=AuthorExt(id=1311360866356920574, tenantId=1146029695717560320, journalId=1240618002186551303, articleId=1311360863915835634, authorId=1311360866268840188, language=EN, stringName=Delai Xue, firstName=Delai, middleName=null, lastName=Xue, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, *, address=1.Yantai AtoN Division, Northern Navigation Service Center, Maritime Safety Administration, People's Republic of China, Yantai 264000, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1311360866432418047, tenantId=1146029695717560320, journalId=1240618002186551303, articleId=1311360863915835634, authorId=1311360866268840188, language=CN, stringName=薛德来, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, *, address=1.交通运输部北海航海保障中心 烟台航标处,山东 烟台 264000, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1311360864607895797, tenantId=1146029695717560320, journalId=1240618002186551303, articleId=1311360863915835634, xref=1., ext=[AuthorCompanyExt(id=1311360864616284406, tenantId=1146029695717560320, journalId=1240618002186551303, articleId=1311360863915835634, companyId=1311360864607895797, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1.Yantai AtoN Division, Northern Navigation Service Center, Maritime Safety Administration, People's Republic of China, Yantai 264000, China), AuthorCompanyExt(id=1311360864624673015, tenantId=1146029695717560320, journalId=1240618002186551303, articleId=1311360863915835634, companyId=1311360864607895797, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1.交通运输部北海航海保障中心 烟台航标处,山东 烟台 264000)])]), Author(id=1311360866524692737, tenantId=1146029695717560320, journalId=1240618002186551303, articleId=1311360863915835634, orderNo=1, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1311360866600190211, tenantId=1146029695717560320, journalId=1240618002186551303, articleId=1311360863915835634, authorId=1311360866524692737, language=EN, stringName=Jingpeng Zhu, firstName=Jingpeng, middleName=null, lastName=Zhu, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, address=1.Yantai AtoN Division, Northern Navigation Service Center, Maritime Safety Administration, People's Republic of China, Yantai 264000, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1311360866679881988, tenantId=1146029695717560320, journalId=1240618002186551303, articleId=1311360863915835634, authorId=1311360866524692737, language=CN, stringName=朱景鹏, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, address=1.交通运输部北海航海保障中心 烟台航标处,山东 烟台 264000, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1311360864607895797, tenantId=1146029695717560320, journalId=1240618002186551303, articleId=1311360863915835634, xref=1., ext=[AuthorCompanyExt(id=1311360864616284406, tenantId=1146029695717560320, journalId=1240618002186551303, articleId=1311360863915835634, companyId=1311360864607895797, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1.Yantai AtoN Division, Northern Navigation Service Center, Maritime Safety Administration, People's Republic of China, Yantai 264000, China), AuthorCompanyExt(id=1311360864624673015, tenantId=1146029695717560320, journalId=1240618002186551303, articleId=1311360863915835634, companyId=1311360864607895797, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1.交通运输部北海航海保障中心 烟台航标处,山东 烟台 264000)])]), Author(id=1311360866742796550, tenantId=1146029695717560320, journalId=1240618002186551303, articleId=1311360863915835634, orderNo=2, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1311360866826682632, tenantId=1146029695717560320, journalId=1240618002186551303, articleId=1311360863915835634, authorId=1311360866742796550, language=EN, stringName=Chuanbo Wu, firstName=Chuanbo, middleName=null, lastName=Wu, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=2, address=2.School of Mechanical Engineering, Hebei University of Science and Technology, Shijiazhuang 050018, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1311360866897985801, tenantId=1146029695717560320, journalId=1240618002186551303, articleId=1311360863915835634, authorId=1311360866742796550, language=CN, stringName=吴川博, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=2, address=2.河北科技大学 机械工程学院,河北 石家庄 050018, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1311360864700170488, tenantId=1146029695717560320, journalId=1240618002186551303, articleId=1311360863915835634, xref=2., ext=[AuthorCompanyExt(id=1311360864712753401, tenantId=1146029695717560320, journalId=1240618002186551303, articleId=1311360863915835634, companyId=1311360864700170488, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2.School of Mechanical Engineering, Hebei University of Science and Technology, Shijiazhuang 050018, China), AuthorCompanyExt(id=1311360864721142010, tenantId=1146029695717560320, journalId=1240618002186551303, articleId=1311360863915835634, companyId=1311360864700170488, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2.河北科技大学 机械工程学院,河北 石家庄 050018)])])]
薛德来1, * , 朱景鹏1, 吴川博2
作者信息
  • 1.交通运输部北海航海保障中心 烟台航标处,山东 烟台 264000
  • 2.河北科技大学 机械工程学院,河北 石家庄 050018
通讯作者:
薛德来(1999—),男,助理工程师,研究方向为航标技术管理,(E-mail)
Autonomous navigation method for aids to navigation based on improved proximal policy optimization
Delai Xue1, * , Jingpeng Zhu1, Chuanbo Wu2
Affiliations
  • 1.Yantai AtoN Division, Northern Navigation Service Center, Maritime Safety Administration, People's Republic of China, Yantai 264000, China
  • 2.School of Mechanical Engineering, Hebei University of Science and Technology, Shijiazhuang 050018, China
出版时间: 2026-08-25 doi: 10.3969/j.issn.1000-4653.2026.04.005
文章导航
收藏切换

在近海港口航道繁忙水域,海上实体航标极易发生碰撞,导致标体损坏,无法正常运行。为解决现有方案针对航标自航研究领域空白,不能实现自主航行避碰,未能有效结合人工智能技术使其智能化航行工作等问题,提出一种改进近端策略优化并结合速度障碍的航标自航方法。近端策略优化算法采用离线学习方式提高网络更新效率,设计航标自航动作空间,能更快实现模型收敛;但在模型收敛时容易陷入局部最优,为避免模型陷入局部最优,结合速度障碍算法表示状态空间,用速度向量设计奖励函数,使其在计算距离奖励函数基础上,增加基于位置和速度信息的奖励函数,提高收敛速度,并满足航标在近海港口航道中自适应地选择最佳速度;为提高算法鲁棒性,增加熵奖励函数对近端策略优化算法改进,以激励更多探索。试验表明,增加熵奖励函数与未增加相比,在平均航行步长、平均航行速度等指标上分别提升了9.3%、10.2%,且模型测试成功率保持在99%以上。该方法实现了航标无人操控、自主航行及避碰的安全作业模式,降低航标在繁忙水域被碰撞损坏的风险,减少人工巡检和维护成本。对加快构建现代化航海保障体系、保障海上航行安全具有重要战略意义。

航行安全  /  航标自主航行  /  改进近端策略优化  /  熵奖励  /  航标避碰  /  航标保护

In the busy waters of nearshore port channels, physical Aids to Navigation (AtoN) are highly susceptible to collisions, which may cause structural damage and prevent them from operating normally. To address the research gap in autonomous navigation of AtoN, including the inability of existing methods to achieve autonomous navigation and collision avoidance and their insufficient integration with artificial intelligence technologies for intelligent navigation, this paper proposes an autonomous navigation method for AtoN based on improved Proximal Policy Optimization (PPO) combined with the Velocity Obstacle (VO) algorithm. The PPO algorithm was improved by introducing an offline learning strategy to enhance network update efficiency. By designing the autonomous navigation action space for AtoN, the model can achieve faster convergence. However, the model is prone to falling into local optima during convergence. To avoid this problem, the VO algorithm is incorporated to represent the state space, and a reward function is designed using velocity vectors. On the basis of calculating the distance-based reward function, an additional reward function based on position and velocity information is introduced to improve convergence speed and enable AtoN to adaptively select the optimal velocity in nearshore port channels. To further enhance algorithm robustness, an entropy reward term is added to the PPO algorithm to encourage greater exploration. Experimental results show that, compared with the method without the entropy reward term, the proposed method improves the average navigation step length and average navigation velocity by 9.3% and 10.2%, respectively, while maintaining a model test success rate of over 99%. The proposed method enables a safe operational mode featuring unmanned control, autonomous navigation, and collision avoidance for AtoN. It can reduce the collision damage risk of AtoN in busy waters and lower the costs of manual inspection and maintenance. The study is of significance for accelerating the construction of a modern maritime navigation support system and ensuring maritime navigation safety.

navigation safety  /  autonomous navigation of AtoN  /  improved proximal policy optimization  /  entropy reward  /  AtoN collision avoidance  /  AtoN protection
薛德来, 朱景鹏, 吴川博. 基于改进近端策略优化的航标自航方法研究. 中国航海, 2026 , 49 (4) : 39 -46 . DOI: 10.3969/j.issn.1000-4653.2026.04.005
Delai Xue, Jingpeng Zhu, Chuanbo Wu. Autonomous navigation method for aids to navigation based on improved proximal policy optimization[J]. Navigation of China, 2026 , 49 (4) : 39 -46 . DOI: 10.3969/j.issn.1000-4653.2026.04.005
  • 河北省自然科学基金青年项目(E2026208041)
  • 河北省高等学校科学研究青年拔尖人才项目(BJ2026336)
参考文献 引证文献
排序方式:
2026年第49卷第4期
PDF下载
113
26
引用本文
BibTeX
文章信息
doi: 10.3969/j.issn.1000-4653.2026.04.005
  • 接收时间:2025-12-10
  • 首发时间:2026-09-28
  • 出版时间:2026-08-25
补充材料
相关文章
文章信息
作者
出版历史
  • 收稿日期:2025-12-10
基金
河北省自然科学基金青年项目(E2026208041)
河北省高等学校科学研究青年拔尖人才项目(BJ2026336)
作者信息
    1.交通运输部北海航海保障中心 烟台航标处,山东 烟台 264000
    2.河北科技大学 机械工程学院,河北 石家庄 050018

通讯作者:

薛德来(1999—),男,助理工程师,研究方向为航标技术管理,(E-mail)
参考文献
分享链接
https://castjournals.cast.org.cn/joweb/zghh/CN/10.3969/j.issn.1000-4653.2026.04.005
分享至
全文二维码

扫描看全文

引用本文
BibTeX
本文的引用情况
2种不同金属材料的力学参数
科
Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)
属
Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏