Article(id=1221497399336424292, tenantId=1146029695717560320, journalId=1210938733613449225, issueId=1221497393514730153, articleNumber=null, orderNo=null, doi=10.19666/j.rlfd.202208176, pmid=null, cstr=null, oa=null, hot=null, price=null, onlineType=0, articleFormat=0, articleType=null, articleTypeStr=null, receivedDate=1661356800000, receivedDateStr=2022-08-25, revisedDate=null, revisedDateStr=null, acceptedDate=null, acceptedDateStr=null, onlineDate=1769157274326, onlineDateStr=2026-01-23, pubDate=1682352000000, pubDateStr=2023-04-25, doiRegisterDate=null, doiRegisterDateStr=null, onlineIssueDate=1769157274326, onlineIssueDateStr=2026-01-23, onlineJustAcceptDate=null, onlineJustAcceptDateStr=null, onlineFirstDate=null, onlineFirstDateStr=null, sourceXml=null, magXml=null, createTime=1769157274326, creator=13701087609, updateTime=1769157274326, updator=13701087609, issue=Issue{id=1221497393514730153, tenantId=1146029695717560320, journalId=1210938733613449225, year='2023', volume='52', issue='4', pageStart='1', pageEnd='166', issueExtLink='null', onlineDate='null', pubDate='null', beforeIssueId=null, nextIssueId=null, price=null, status=1, issueComplete=1, articleOrder=1, issueType=-1, specialIssue=null, createTime=1769157272938, creator=13701087609, updateTime=1769157397933, updator=13701087609, preIssue=null, nextIssue=null, ext={EN=IssueExt(id=1221497917878223060, tenantId=1146029695717560320, journalId=1210938733613449225, issueId=1221497393514730153, language=EN, specialIssueTitle=, coverIllustrator=null, specialIssueEditor=, specialIssueAbout=), CN=IssueExt(id=1221497917878223061, tenantId=1146029695717560320, journalId=1210938733613449225, issueId=1221497393514730153, language=CN, specialIssueTitle=, coverIllustrator=null, specialIssueEditor=, specialIssueAbout=)}, issueFiles=null}, startPage=104, endPage=112, ext={EN=ArticleExt(id=1221497399596471157, articleId=1221497399336424292, tenantId=1146029695717560320, journalId=1210938733613449225, language=EN, title=Multi-condition adaptive control of combined heat and power unit based on deep reinforcement learning, columnId=1221467202000175547, journalTitle=Thermal Power Generation, columnName=Thermal energy and science research, runingTitle=null, highlight=null, articleAbstract=

Combined heat and power (CHP) units are affected by the output fluctuation of large-scale operating conditions, resulting in poor overall control quality of power generation load-extraction steam flow-throttle pressure in the turbine-boiler coordinated control system. To solve this problem, a multi-condition adaptive control method based on multi-agent deep deterministic policy gradient (MA-DDPG) is proposed. Firstly, according to the nonlinear dynamic mechanism of the unit, multiple operating condition sub-models considering the changes of state parameters are established, and the optimal operating condition sub-model is obtained by the integral function switching mechanism. For the multi-loop complex control requirements of the coordinated control system, a multi-agent synchronous operation mechanism is proposed, and the reward function is designed with the coordinated control objectives of rapid response, stable heating and safe operation. Finally, by training the agent to interact with the environment, the multi-loop gains are continuously adjusted online to achieve multi-condition adaptive control. Simulation results show that, compared with the conventional control method, the proposed method can effectively improve the load response rate under wide range operating conditions, and ensure the stability of heating.

, correspAuthors=null, authorNote=null, correspAuthorsNote=null, copyrightStatement=null, copyrightOwner=null, extLink=null, articleAbsUrl=null, sourceXml=null, magXml=null, pdfUrl=null, pdf=null, pdfFileSize=null, pdfExtLink=null, richHtmlUrl=null, mobilePdfUrl=null, reviewReport=null, pdfFirstPage=null, abstractGraph=null, abstractGraphContent=null, abstractVideo=null, citation=null, cebUrl=null, magXmlContent=null, mapNumber=null, authorCompany=null, fund=null, authors=null, authorsList=Jing YE, Xia CAI, Lei ZHANG, Nan YANG, Zhenhua LI), CN=ArticleExt(id=1221497399789409157, articleId=1221497399336424292, tenantId=1146029695717560320, journalId=1210938733613449225, language=CN, title=基于深度强化学习的热电联产机组多工况自适应控制, columnId=1211002405437706993, journalTitle=热力发电, columnName=热能科学研究, runingTitle=null, highlight=null, articleAbstract=

针对热电联产机组受大范围出力工况运行波动性影响,导致汽轮机-锅炉协调控制系统发电负荷-抽汽流量-机前压力整体控制品质较差,提出一种基于多智能体深度确定性策略梯度(MA-DDPG)的多工况自适应控制方法。首先,根据机组非线性动态机理建立计及关键状态参数变化的多个工况子模型,利用积分型函数切换机制获取最优工况子模型;其次,提出一种多智能体同步运行机制,以快速响应、稳定供热及安全运行为协调控制目标来设计奖励函数,通过训练智能体与环境进行互动,不断在线调整多回路增益,实现机组多工况自适应控制。仿真结果表明,与传统控制方法相比,所提方法在保证供热平稳性的同时,有效提升了机组大范围出力工况发电负荷响应速率。

, correspAuthors=null, authorNote=null, correspAuthorsNote=
张磊(1986),男,博士,副教授,主要研究方向为大规模新能源接入电力系统的优化调度,
, copyrightStatement=null, copyrightOwner=null, extLink=null, articleAbsUrl=null, sourceXml=E1wgGZT4F3Xrr8nFo3sLFg==, magXml=CyUxb243GBVHoGPxnSsBXA==, pdfUrl=null, pdf=/AHDvRVSAhwJz2TUo44/jw==, pdfFileSize=1926135, pdfExtLink=null, richHtmlUrl=null, mobilePdfUrl=null, reviewReport=null, pdfFirstPage=null, abstractGraph=null, abstractGraphContent=null, abstractVideo=null, citation=null, cebUrl=null, magXmlContent=XocoT8EFKQaX7DHlTXGQgA==, mapNumber=null, authorCompany=null, fund=null, authors=

叶婧(1986),女,博士,讲师,主要研究方向为大规模新能源接入后电力系统优化运行与控制,

, authorsList=叶婧, 蔡霞, 张磊, 杨楠, 李振华)}, authors=[Author(id=1221497400062038935, tenantId=1146029695717560320, journalId=1210938733613449225, articleId=1221497399336424292, orderNo=0, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=yejing2000310@163.com, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1221497400145925020, tenantId=1146029695717560320, journalId=1210938733613449225, articleId=1221497399336424292, authorId=1221497400062038935, language=EN, stringName=Jing YE, firstName=Jing, middleName=null, lastName=YE, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=College of Electrical Engineering and New Energy, China Three Gorges University, Yichang 443002, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1221497400217228195, tenantId=1146029695717560320, journalId=1210938733613449225, articleId=1221497399336424292, authorId=1221497400062038935, language=CN, stringName=叶婧, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=三峡大学电气与新能源学院,湖北 宜昌 443002, bio={"content":"

叶婧(1986),女,博士,讲师,主要研究方向为大规模新能源接入后电力系统优化运行与控制,

"}, bioImg=null, bioContent=

叶婧(1986),女,博士,讲师,主要研究方向为大规模新能源接入后电力系统优化运行与控制,

, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1221497399969764239, tenantId=1146029695717560320, journalId=1210938733613449225, articleId=1221497399336424292, xref=null, ext=[AuthorCompanyExt(id=1221497399978152848, tenantId=1146029695717560320, journalId=1210938733613449225, articleId=1221497399336424292, companyId=1221497399969764239, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=College of Electrical Engineering and New Energy, China Three Gorges University, Yichang 443002, China), AuthorCompanyExt(id=1221497399982347153, tenantId=1146029695717560320, journalId=1210938733613449225, articleId=1221497399336424292, companyId=1221497399969764239, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=三峡大学电气与新能源学院,湖北 宜昌 443002)])]), Author(id=1221497400284337066, tenantId=1146029695717560320, journalId=1210938733613449225, articleId=1221497399336424292, orderNo=1, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1221497400347251634, tenantId=1146029695717560320, journalId=1210938733613449225, articleId=1221497399336424292, authorId=1221497400284337066, language=EN, stringName=Xia CAI, firstName=Xia, middleName=null, lastName=CAI, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=College of Electrical Engineering and New Energy, China Three Gorges University, Yichang 443002, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1221497400456303546, tenantId=1146029695717560320, journalId=1210938733613449225, articleId=1221497399336424292, authorId=1221497400284337066, language=CN, stringName=蔡霞, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=三峡大学电气与新能源学院,湖北 宜昌 443002, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1221497399969764239, tenantId=1146029695717560320, journalId=1210938733613449225, articleId=1221497399336424292, xref=null, ext=[AuthorCompanyExt(id=1221497399978152848, tenantId=1146029695717560320, journalId=1210938733613449225, articleId=1221497399336424292, companyId=1221497399969764239, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=College of Electrical Engineering and New Energy, China Three Gorges University, Yichang 443002, China), AuthorCompanyExt(id=1221497399982347153, tenantId=1146029695717560320, journalId=1210938733613449225, articleId=1221497399336424292, companyId=1221497399969764239, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=三峡大学电气与新能源学院,湖北 宜昌 443002)])]), Author(id=1221497400552772543, tenantId=1146029695717560320, journalId=1210938733613449225, articleId=1221497399336424292, orderNo=2, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=leizhang3188@163.com, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1221497400645047236, tenantId=1146029695717560320, journalId=1210938733613449225, articleId=1221497399336424292, authorId=1221497400552772543, language=EN, stringName=Lei ZHANG, firstName=Lei, middleName=null, lastName=ZHANG, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=College of Electrical Engineering and New Energy, China Three Gorges University, Yichang 443002, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1221497400733127626, tenantId=1146029695717560320, journalId=1210938733613449225, articleId=1221497399336424292, authorId=1221497400552772543, language=CN, stringName=张磊, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=三峡大学电气与新能源学院,湖北 宜昌 443002, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1221497399969764239, tenantId=1146029695717560320, journalId=1210938733613449225, articleId=1221497399336424292, xref=null, ext=[AuthorCompanyExt(id=1221497399978152848, tenantId=1146029695717560320, journalId=1210938733613449225, articleId=1221497399336424292, companyId=1221497399969764239, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=College of Electrical Engineering and New Energy, China Three Gorges University, Yichang 443002, China), AuthorCompanyExt(id=1221497399982347153, tenantId=1146029695717560320, journalId=1210938733613449225, articleId=1221497399336424292, companyId=1221497399969764239, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=三峡大学电气与新能源学院,湖北 宜昌 443002)])]), Author(id=1221497400812819403, tenantId=1146029695717560320, journalId=1210938733613449225, articleId=1221497399336424292, orderNo=3, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1221497400913482703, tenantId=1146029695717560320, journalId=1210938733613449225, articleId=1221497399336424292, authorId=1221497400812819403, language=EN, stringName=Nan YANG, firstName=Nan, middleName=null, lastName=YANG, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=College of Electrical Engineering and New Energy, China Three Gorges University, Yichang 443002, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1221497401047700434, tenantId=1146029695717560320, journalId=1210938733613449225, articleId=1221497399336424292, authorId=1221497400812819403, language=CN, stringName=杨楠, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=三峡大学电气与新能源学院,湖北 宜昌 443002, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1221497399969764239, tenantId=1146029695717560320, journalId=1210938733613449225, articleId=1221497399336424292, xref=null, ext=[AuthorCompanyExt(id=1221497399978152848, tenantId=1146029695717560320, journalId=1210938733613449225, articleId=1221497399336424292, companyId=1221497399969764239, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=College of Electrical Engineering and New Energy, China Three Gorges University, Yichang 443002, China), AuthorCompanyExt(id=1221497399982347153, tenantId=1146029695717560320, journalId=1210938733613449225, articleId=1221497399336424292, companyId=1221497399969764239, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=三峡大学电气与新能源学院,湖北 宜昌 443002)])]), Author(id=1221497401119003606, tenantId=1146029695717560320, journalId=1210938733613449225, articleId=1221497399336424292, orderNo=4, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1221497401186112474, tenantId=1146029695717560320, journalId=1210938733613449225, articleId=1221497399336424292, authorId=1221497401119003606, language=EN, stringName=Zhenhua LI, firstName=Zhenhua, middleName=null, lastName=LI, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=College of Electrical Engineering and New Energy, China Three Gorges University, Yichang 443002, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1221497401244832733, tenantId=1146029695717560320, journalId=1210938733613449225, articleId=1221497399336424292, authorId=1221497401119003606, language=CN, stringName=李振华, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=null, address=三峡大学电气与新能源学院,湖北 宜昌 443002, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1221497399969764239, tenantId=1146029695717560320, journalId=1210938733613449225, articleId=1221497399336424292, xref=null, ext=[AuthorCompanyExt(id=1221497399978152848, tenantId=1146029695717560320, journalId=1210938733613449225, articleId=1221497399336424292, companyId=1221497399969764239, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=College of Electrical Engineering and New Energy, China Three Gorges University, Yichang 443002, China), AuthorCompanyExt(id=1221497399982347153, tenantId=1146029695717560320, journalId=1210938733613449225, articleId=1221497399336424292, companyId=1221497399969764239, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=三峡大学电气与新能源学院,湖北 宜昌 443002)])])], keywords=[Keyword(id=1221497401337107427, tenantId=1146029695717560320, journalId=1210938733613449225, articleId=1221497399336424292, language=EN, orderNo=1, keyword=CHP unit), Keyword(id=1221497401412604904, tenantId=1146029695717560320, journalId=1210938733613449225, articleId=1221497399336424292, language=EN, orderNo=2, keyword=MA-DDPG), Keyword(id=1221497401488102378, tenantId=1146029695717560320, journalId=1210938733613449225, articleId=1221497399336424292, language=EN, orderNo=3, keyword=multi-condition adaptive control), Keyword(id=1221497401559405552, tenantId=1146029695717560320, journalId=1210938733613449225, articleId=1221497399336424292, language=EN, orderNo=4, keyword=heating stability), Keyword(id=1221497401630708722, tenantId=1146029695717560320, journalId=1210938733613449225, articleId=1221497399336424292, language=EN, orderNo=5, keyword=load response rate), Keyword(id=1221497401710400500, tenantId=1146029695717560320, journalId=1210938733613449225, articleId=1221497399336424292, language=CN, orderNo=1, keyword=热电联产机组), Keyword(id=1221497401777509366, tenantId=1146029695717560320, journalId=1210938733613449225, articleId=1221497399336424292, language=CN, orderNo=2, keyword=MA-DDPG), Keyword(id=1221497401840423931, tenantId=1146029695717560320, journalId=1210938733613449225, articleId=1221497399336424292, language=CN, orderNo=3, keyword=多工况自适应控制), Keyword(id=1221497401907532798, tenantId=1146029695717560320, journalId=1210938733613449225, articleId=1221497399336424292, language=CN, orderNo=4, keyword=供热平稳性), Keyword(id=1221497401957863424, tenantId=1146029695717560320, journalId=1210938733613449225, articleId=1221497399336424292, language=CN, orderNo=5, keyword=负荷响应速率)], refs=null, funds=[Fund(id=1221497402045943813, tenantId=1146029695717560320, journalId=1210938733613449225, articleId=1221497399336424292, awardId=52007103, language=EN, fundingSource=National Natural Science Foundation of China(52007103), fundOrder=null, country=null), Fund(id=1221497402108858375, tenantId=1146029695717560320, journalId=1210938733613449225, articleId=1221497399336424292, awardId=52007103, language=CN, fundingSource=国家自然科学基金项目(52007103), fundOrder=null, country=null)], companyList=[AuthorCompany(id=1221497399969764239, tenantId=1146029695717560320, journalId=1210938733613449225, articleId=1221497399336424292, xref=null, ext=[AuthorCompanyExt(id=1221497399978152848, tenantId=1146029695717560320, journalId=1210938733613449225, articleId=1221497399336424292, companyId=1221497399969764239, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=College of Electrical Engineering and New Energy, China Three Gorges University, Yichang 443002, China), AuthorCompanyExt(id=1221497399982347153, tenantId=1146029695717560320, journalId=1210938733613449225, articleId=1221497399336424292, companyId=1221497399969764239, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=三峡大学电气与新能源学院,湖北 宜昌 443002)])], figs=null, attaches=null, journal=Journal(id=1210938006006558725, delFlag=0, nameCn=热力发电, nameEn=Thermal Power Generation, nameHistory1=null, nameHistory2=null, issn=1002-3364, eissn=null, cn=61-1111/TM, coden=null, periodic=0, language=CN, oaType=null, ccby=null, superviseOffice=null, ownerOffice=null, pubOffice=null, editorOffice=null, officeType=null, aims=null, clcCode=null, officeProv=null, officeCity=null, officeAddr=null, officeZip=null, officeEmail=null, officePhone=null, editDirector=null, officeDirector=null, officeDirectorPhone=null, officeStaffNum=null, officeEmpNum=null, coverPicUrl=YWgAUXbKXZzTw3c+kJbAIA==, journalPrice=null, startedYear=null, abbrevIsoEn=Thermal Power Generation, journalRemark=null, publicationField=null, createdTime=1766639718774, updatedTime=1766640759031, createdBy=18614031015, updatedBy=13701087609, firstLetterCn=T, firstLetterEn=T, subjectCode=Engineering, subjectName=null, subjectCodeEn=Engineering, subjectNameEn=null, picCn=YWgAUXbKXZzTw3c+kJbAIA==, picEn=jfJjUlYAGfUZwuOMQZ6AHQ==, jcr=null, cjcr=null, exts=[JournalExt(id=1210942369256575009, language=CN, name=热力发电, nameHistory1=null, nameHistory2=null, managedBy=, sponsoredBy=, publishedBy=, editorOffice=, officeProv=null, officeCity=null, officeAddr=, officeZip=, editDirector=, officeDirector=null, officePhone=null, coverPicUrl=null, journalRemark=, submitArticleUrl=null, websiteUrl=, createdTime=1766640759052, updatedTime=1766640759052, createdBy=13701087609, updatedBy=13701087609, submissionGuidelinesUrl=, submissionAuthorUrl=https://rlfd.chinajournal.net.cn/index.aspx?t=1, submissionEditorUrl=https://rlfd.chinajournal.net.cn/index.aspx?t=3, submissionReviewUrl=https://rlfd.chinajournal.net.cn/index.aspx?t=2, submissionCeEditorUrl=, submissionAeEditorUrl=, option={"copyright":""}), JournalExt(id=1210942369315295266, language=EN, name=Thermal Power Generation, nameHistory1=null, nameHistory2=null, managedBy=, sponsoredBy=, publishedBy=, editorOffice=, officeProv=null, officeCity=null, officeAddr=, officeZip=, editDirector=, officeDirector=null, officePhone=null, coverPicUrl=null, journalRemark=, submitArticleUrl=null, websiteUrl=, createdTime=1766640759066, updatedTime=1766640759066, createdBy=13701087609, updatedBy=13701087609, submissionGuidelinesUrl=, submissionAuthorUrl=https://rlfd.chinajournal.net.cn/index.aspx?t=1, submissionEditorUrl=https://rlfd.chinajournal.net.cn/index.aspx?t=3, submissionReviewUrl=https://rlfd.chinajournal.net.cn/index.aspx?t=2, submissionCeEditorUrl=, submissionAeEditorUrl=, option={"copyright":""})], databaseList=null, tenantJournalId=1210938733613449225, websiteList=[Website(id=1210941118787744741, webName=null, webTitle=null, webDomain=null, webCopyrigh=null, webIpcNo=null, seoTitle=null, seoKeywords=null, seoDescription=null, tenantJournalId=null, journalId=1210938733613449225, journalNameCn=null, journalNameEn=null, grayFlag=null, tenantId=1146029695717560320, platformId=null, journalGroupId=null, journalGroupNameCn=null, journalGroupNameEn=null, type=1, domain=https://castjournals.cast.org.cn/joweb/rlfd/CN, language=CN, createTime=1766640460918, createBy=18614031015, updateTime=1766640511525, updateBy=18614031015, name=热力发电-中文, tplId=1146099689490845704, title=热力发电, delFlag=0, indexPage=/home, props=[WebsiteProps(id=1210944690380214659, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1210941118787744741, code=articleTextType, value=kx, createTime=1766641312451, updateTime=1766641312451, creator=18614031015, updator=18614031015), WebsiteProps(id=1210944690359243136, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1210941118787744741, code=banner, value=null, createTime=1766641312446, updateTime=1766641312446, creator=18614031015, updator=18614031015), WebsiteProps(id=1210944690401186182, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1210941118787744741, code=grayFlag, value=0, createTime=1766641312456, updateTime=1766641312456, creator=18614031015, updator=18614031015), WebsiteProps(id=1210944690346660223, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1210941118787744741, code=logo, value=https://castjournals.cast.org.cn/joweb/rlfd/CN/file/pic?fileId=ToFA0Lu4b/CNocENDvNjHA==, createTime=1766641312443, updateTime=1766641312443, creator=18614031015, updator=18614031015), WebsiteProps(id=1210944690409574792, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1210941118787744741, code=minRunFlag, value=0, createTime=1766641312458, updateTime=1766641312458, creator=18614031015, updator=18614031015), WebsiteProps(id=1210944690371826050, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1210941118787744741, code=picServerUrl, value=https://castjournals.cast.org.cn/joweb/rlfd/CN/file/pic, createTime=1766641312449, updateTime=1766641312449, creator=18614031015, updator=18614031015), WebsiteProps(id=1210944690405380487, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1210941118787744741, code=silenceFlag, value=0, createTime=1766641312457, updateTime=1766641312457, creator=18614031015, updator=18614031015), WebsiteProps(id=1210944690367631745, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1210941118787744741, code=staticResourcePath, value=https://castjournals.cast.org.cn/joweb/cast_kjdb_cn_619/, createTime=1766641312448, updateTime=1766641312448, creator=18614031015, updator=18614031015), WebsiteProps(id=1210944690388603268, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1210941118787744741, code=themeColor, value=null, createTime=1766641312453, updateTime=1766641312453, creator=18614031015, updator=18614031015), WebsiteProps(id=1210944690392797573, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1210941118787744741, code=themeStyle, value=null, createTime=1766641312454, updateTime=1766641312454, creator=18614031015, updator=18614031015)]), Website(id=1210941118926156777, webName=null, webTitle=null, webDomain=null, webCopyrigh=null, webIpcNo=null, seoTitle=null, seoKeywords=null, seoDescription=null, tenantJournalId=null, journalId=1210938733613449225, journalNameCn=null, journalNameEn=null, grayFlag=null, tenantId=1146029695717560320, platformId=null, journalGroupId=null, journalGroupNameCn=null, journalGroupNameEn=null, type=1, domain=https://castjournals.cast.org.cn/joweb/rlfd/EN, language=EN, createTime=1766640460950, createBy=18614031015, updateTime=1766640598724, updateBy=18614031015, name=热力发电-英文, tplId=1146101810881728533, title=Thermal Power Generation, delFlag=0, indexPage=/home, props=[WebsiteProps(id=1210944709317489283, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1210941118926156777, code=articleTextType, value=kx, createTime=1766641316966, updateTime=1766641316966, creator=18614031015, updator=18614031015), WebsiteProps(id=1210944709296517760, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1210941118926156777, code=banner, value=null, createTime=1766641316961, updateTime=1766641316961, creator=18614031015, updator=18614031015), WebsiteProps(id=1210944709334266502, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1210941118926156777, code=grayFlag, value=0, createTime=1766641316970, updateTime=1766641316970, creator=18614031015, updator=18614031015), WebsiteProps(id=1210944709288129151, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1210941118926156777, code=logo, value=https://castjournals.cast.org.cn/joweb/rlfd/CN/file/pic?fileId=ToFA0Lu4b/CNocENDvNjHA==, createTime=1766641316959, updateTime=1766641316959, creator=18614031015, updator=18614031015), WebsiteProps(id=1210944709346849416, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1210941118926156777, code=minRunFlag, value=0, createTime=1766641316973, updateTime=1766641316973, creator=18614031015, updator=18614031015), WebsiteProps(id=1210944709309100674, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1210941118926156777, code=picServerUrl, value=https://castjournals.cast.org.cn/joweb/rlfd/EN/file/pic, createTime=1766641316964, updateTime=1766641316964, creator=18614031015, updator=18614031015), WebsiteProps(id=1210944709338460807, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1210941118926156777, code=silenceFlag, value=0, createTime=1766641316971, updateTime=1766641316971, creator=18614031015, updator=18614031015), WebsiteProps(id=1210944709300712065, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1210941118926156777, code=staticResourcePath, value=https://castjournals.cast.org.cn/joweb/cast_kjdb_en_623/, createTime=1766641316962, updateTime=1766641316962, creator=18614031015, updator=18614031015), WebsiteProps(id=1210944709321683588, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1210941118926156777, code=themeColor, value=null, createTime=1766641316967, updateTime=1766641316967, creator=18614031015, updator=18614031015), WebsiteProps(id=1210944709330072197, tenantId=1146029695717560320, journalId=null, journalGroupId=null, siteId=1210941118926156777, code=themeStyle, value=null, createTime=1766641316969, updateTime=1766641316969, creator=18614031015, updator=18614031015)])], journalTitle=热力发电, weixinUrl=null, journalUrl=null, iacademicId=null, status=1, seqNo=null, journalTitleEn=Thermal Power Generation, journalPhotoCn=YWgAUXbKXZzTw3c+kJbAIA==, journalPhotoEn=jfJjUlYAGfUZwuOMQZ6AHQ==, journalFirstLetter=T, journalRecommend=null, journalNew=null, journalCollection=null, jcrJf=null, cjcrJf=null, jcrJfStr=null, cjcrJfStr=null, submissionFirstDecision=null, sciSubjectClassification=null, casSubjectClassification=null, citeScore=null, totalCitationFrequency=null, icpCode=null, psCode=null, advertisingLicenseCode=null, copyrightInformation=null, country=null, option=, provinceCode=null, provinceName=null, collectFlag=false), detailUrlCn=https://castjournals.cast.org.cn/joweb/rlfd/CN/10.19666/j.rlfd.202208176, detailUrlEn=https://castjournals.cast.org.cn/joweb/rlfd/EN/10.19666/j.rlfd.202208176, pdfUrlCn=https://castjournals.cast.org.cn/joweb/rlfd/CN/PDF/10.19666/j.rlfd.202208176, pdfUrlEn=https://castjournals.cast.org.cn/joweb/rlfd/EN/PDF/10.19666/j.rlfd.202208176, aliStartDate=null, aliEndDate=null, collectionFlag=false, citedCount=null, citedUrl=null, reference=null)
收藏切换
基于深度强化学习的热电联产机组多工况自适应控制
收藏切换
PDF下载
叶婧 , 蔡霞 , 张磊 , 杨楠 , 李振华
热力发电 | 热能科学研究 2023,52(4): 104-112
收起
收藏切换
热力发电 | 热能科学研究 2023, 52(4): 104-112
基于深度强化学习的热电联产机组多工况自适应控制
全屏
叶婧 , 蔡霞, 张磊 , 杨楠, 李振华
作者信息
  • 三峡大学电气与新能源学院,湖北 宜昌 443002
  • 叶婧(1986),女,博士,讲师,主要研究方向为大规模新能源接入后电力系统优化运行与控制,

通讯作者:

张磊(1986),男,博士,副教授,主要研究方向为大规模新能源接入电力系统的优化调度,
Multi-condition adaptive control of combined heat and power unit based on deep reinforcement learning
Jing YE , Xia CAI, Lei ZHANG , Nan YANG, Zhenhua LI
Affiliations
  • College of Electrical Engineering and New Energy, China Three Gorges University, Yichang 443002, China
出版时间: 2023-04-25 doi: 10.19666/j.rlfd.202208176
文章导航
收藏切换

针对热电联产机组受大范围出力工况运行波动性影响,导致汽轮机-锅炉协调控制系统发电负荷-抽汽流量-机前压力整体控制品质较差,提出一种基于多智能体深度确定性策略梯度(MA-DDPG)的多工况自适应控制方法。首先,根据机组非线性动态机理建立计及关键状态参数变化的多个工况子模型,利用积分型函数切换机制获取最优工况子模型;其次,提出一种多智能体同步运行机制,以快速响应、稳定供热及安全运行为协调控制目标来设计奖励函数,通过训练智能体与环境进行互动,不断在线调整多回路增益,实现机组多工况自适应控制。仿真结果表明,与传统控制方法相比,所提方法在保证供热平稳性的同时,有效提升了机组大范围出力工况发电负荷响应速率。

热电联产机组  /  MA-DDPG  /  多工况自适应控制  /  供热平稳性  /  负荷响应速率

Combined heat and power (CHP) units are affected by the output fluctuation of large-scale operating conditions, resulting in poor overall control quality of power generation load-extraction steam flow-throttle pressure in the turbine-boiler coordinated control system. To solve this problem, a multi-condition adaptive control method based on multi-agent deep deterministic policy gradient (MA-DDPG) is proposed. Firstly, according to the nonlinear dynamic mechanism of the unit, multiple operating condition sub-models considering the changes of state parameters are established, and the optimal operating condition sub-model is obtained by the integral function switching mechanism. For the multi-loop complex control requirements of the coordinated control system, a multi-agent synchronous operation mechanism is proposed, and the reward function is designed with the coordinated control objectives of rapid response, stable heating and safe operation. Finally, by training the agent to interact with the environment, the multi-loop gains are continuously adjusted online to achieve multi-condition adaptive control. Simulation results show that, compared with the conventional control method, the proposed method can effectively improve the load response rate under wide range operating conditions, and ensure the stability of heating.

CHP unit  /  MA-DDPG  /  multi-condition adaptive control  /  heating stability  /  load response rate
叶婧, 蔡霞, 张磊, 杨楠, 李振华. 基于深度强化学习的热电联产机组多工况自适应控制. 热力发电, 2023 , 52 (4) : 104 -112 . DOI: 10.19666/j.rlfd.202208176
Jing YE, Xia CAI, Lei ZHANG, Nan YANG, Zhenhua LI. Multi-condition adaptive control of combined heat and power unit based on deep reinforcement learning[J]. Thermal Power Generation, 2023 , 52 (4) : 104 -112 . DOI: 10.19666/j.rlfd.202208176
  • 国家自然科学基金项目(52007103)
2023年第52卷第4期
PDF下载
60
11
引用本文
BibTeX
文章信息
doi: 10.19666/j.rlfd.202208176
  • 接收时间:2022-08-25
  • 首发时间:2026-01-23
  • 出版时间:2023-04-25
补充材料
相关文章
文章信息
作者
出版历史
  • 收稿日期:2022-08-25
基金
National Natural Science Foundation of China(52007103)
国家自然科学基金项目(52007103)
作者信息
    三峡大学电气与新能源学院,湖北 宜昌 443002

通讯作者:

张磊(1986),男,博士,副教授,主要研究方向为大规模新能源接入电力系统的优化调度,
参考文献
分享链接
https://castjournals.cast.org.cn/joweb/rlfd/CN/10.19666/j.rlfd.202208176
分享至
全文二维码

扫描看全文

引用本文
BibTeX
本文的引用情况
2种不同金属材料的力学参数

Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)

Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏