收藏切换
Optimal Control of Distributed Hybrid Energy Storage Charge-discharge for HCSY-MG Grid-connected System Based on Improved PPO
收藏切换
Jinjian LI  Student Member, CPSS, Xinggui WANG, Yingjie DING  Student Member, CPSS
Journal of Power Supply | 2025, 23(4) : 255 - 264
Less
收藏切换
Journal of Power Supply | 2025, 23(4): 255-264
• Battery and Energy Storage •
Optimal Control of Distributed Hybrid Energy Storage Charge-discharge for HCSY-MG Grid-connected System Based on Improved PPO
Full
Jinjian LI  Student Member, CPSS, Xinggui WANG, Yingjie DING  Student Member, CPSS
Affiliations
  • College of Electrical and Information Engineering, Lanzhou University of Technology, Lanzhou 730050, China
Published: 2025-07-30 doi: 10.13234/j.issn.2095-2805.2025.4.255
Outline
收藏切换

To mitigate the fluctuations in the output from micro-sources within a half-bridge converter series Y-connection microgrid (HCSY-MG) grid-connected system and ensure both the balance of the sum of DC-side voltages in each phase and the balance of three-phase grid-connected current, a distributed hybrid energy storage system (HESS) charge-discharge optimal control strategy based on improved proximal policy optimization (PPO) is put forward. With the consideration of grid-connected current in the HCSY-MG system and the characteristics of the distributed HESS, the key system variables affecting the grid-connected current are identified, and the optimal topology for integrating the HESS into the system is determined. Subsequently, by combining the characteristics of the series-connected system, the charge-discharge problem of the distributed HESS is transformed into a Markov decision process within the framework of deep reinforcement learning. Meanwhile, to address the challenge of determining the entropy loss weight in the PPO method, an improved PPO method is proposed, which balances the agent’s convergence and exploration capabilities. Finally, the typical operational data of a renewable energy generation site is used as a case study, and the feasibility and effectiveness of the proposed control strategy is validated.

Series-connected microgrid  /  distributed hybrid energy storage system (HESS)  /  proximal policy optimization (PPO)  /  charge-discharge power  /  deep reinforcement learning
李锦键中国电源学会学生会员, 王兴贵, 丁颖杰中国电源学会学生会员. 基于改进PPO的HCSY-MG并网系统分布式混合储能充放电优化控制. 电源学报, 2025 , 23 (4) : 255 -264 . DOI: 10.13234/j.issn.2095-2805.2025.4.255
Jinjian LI, Xinggui WANG, Yingjie DING. Optimal Control of Distributed Hybrid Energy Storage Charge-discharge for HCSY-MG Grid-connected System Based on Improved PPO[J]. Journal of Power Supply, 2025 , 23 (4) : 255 -264 . DOI: 10.13234/j.issn.2095-2805.2025.4.255
  • National Natural Science Foundation of China(51967011)
Year 2025 volume 23 Issue 4
66
20
Cite this Article
BibTeX
Article Info
doi: 10.13234/j.issn.2095-2805.2025.4.255
  • Receive Date:2024-08-14
  • Online Date:2026-10-26
  • Published:2025-07-30
Article Data
Affiliations
History
  • Received:2024-08-14
  • Revised:2024-09-18
  • Accepted:2024-10-07
Funding
National Natural Science Foundation of China(51967011)
Affiliations
    College of Electrical and Information Engineering, Lanzhou University of Technology, Lanzhou 730050, China
References
Share
https://castjournals.cast.org.cn/joweb/dyxb/EN/10.13234/j.issn.2095-2805.2025.4.255
Share to
QR

Scan QR to access full text

Cite this article
BibTeX
Citations
表12种不同金属材料的力学参数
科
Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)
属
Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏
  • BibTeX
  • EndNote
  • RefWorks
  • TxT