规模化新能源接入电网下的多区域协同算法
-
吴应双
1
,
-
刘蔚
2
,
-
刘明顺
1
,
-
张野
2
,
-
王寅
1
,
-
唐王倩云
2
作者信息
+
1.贵州电网公司电力调度控制中心,贵阳 550000
2.直流输电技术全国重点实验室(南方电网科学研究院),广州 510663
|
吴应双(1988),男,工程师,博士,从事电力系统分析、运行与控制、新能源并网控制工作,871340366@qq.com;
|
|
刘蔚(1974),男,通信作者,高级工程师,博士,从事交直流混合大电网仿真与计算分析工作,liuwei3@csg.cn;
|
|
刘明顺(1986),男,高级工程师,硕士,从事电网分析、运行与控制工作,lms2800@qq.com。
|
收起
Multi-Area Cooperative Algorithm Under Large-Scale New Energy Access to Power Grid
Author information
+
1.Power Dispatching and Control Center of Guizhou Power Grid Co. , Ltd. , Guiyang 550000, China
2.State Key Laboratory of HVDC, Electric Power Research Institute, CSG, Guangzhou 510663, China
Show less
文章历史
+
| 收稿日期 |
出版日期 |
| 2024-11-04 |
2025-09-20 |
PDF (4739K)
摘要
可再生能源的规模化接入电网具有间歇性和强随机特性,容易引起显著的频率波动。针对多区域互联电网,现有的基于神经网络的多智能体协同算法在面对强随机扰动时,常因梯度爆炸和梯度消失问题导致控制性能并不理想。为此,提出了一种自适应权重残差近端策略优化自动发电控制方法。该方法将智能体策略神经网络的各层之间通过残差连接,并为残差连接添加一个可训练的自适应权重,以取得最优的残差比例,缓解神经网络梯度爆炸和梯度消失问题,从而使得深层网络的训练过程更加稳定和高效,进而更快地获得强随机扰动下的多区域协同最优解,以消除由于强随机扰动所引起的频率波动。通过在IEEE两区域和三区域负荷频率控制系统上的仿真测试验证了所提算法的有效性。且相较于多种强化学习算法,所提算法具有更快的收敛性和更强的稳定性,更高的频率稳定性及控制性能。
Abstract
The large-scale access of renewable energy to the power grid has intermittent and strong random characteristics, which is easy to cause significant frequency fluctuations. For multi-area power grids, the existing multi-agent cooperative algorithms based on neural networks often have unsatisfactory control performance due to gradient explosion and gradient disappearance in the face of strong random disturbances. To this end, this paper proposes an adaptive weight residual proximal policy optimization method for automatic power generation control. This method connects the layers of the agent policy neural network through residual connections, and adds a trainable adaptive weight to the residual connection to achieve the optimal residual ratio and alleviate the problem of gradient explosion and gradient disappearance of the neural network, so that the training process of the deep network is more stable and efficient, and then the multi-area cooperative optimal solution under strong random disturbance is obtained faster to eliminate the frequency fluctuation caused by strong random disturbance. The effectiveness of the proposed algorithm is verified by simulation tests on IEEE two-area and three-area load frequency control systems. Compared with various reinforcement learning algorithms, the proposed algorithm has faster convergence and stronger stability, higher frequency stability and control performance.
Graphical abstract
关键词
多区域互联电网
/
近端策略优化
/
自适应权重
/
残差连接
Key words
multi-area power grids
/
proximal policy optimization
/
adaptive weight
/
residual connection
[Author(id=1200799222069481604, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200799072731283881, orderNo=0, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=871340366@qq.com, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1200799222153367692, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200799072731283881, authorId=1200799222069481604, language=EN, stringName=Yingshuang WU, firstName=Yingshuang, middleName=null, lastName=WU, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, address=1.Power Dispatching and Control Center of Guizhou Power Grid Co. , Ltd. , Guiyang 550000, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1200799222203699344, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200799072731283881, authorId=1200799222069481604, language=CN, stringName=吴应双, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, address=1.贵州电网公司电力调度控制中心,贵阳 550000, bio={"content":"吴应双(1988),男,工程师,博士,从事电力系统分析、运行与控制、新能源并网控制工作,871340366@qq.com;
"}, bioImg=null, bioContent=吴应双(1988),男,工程师,博士,从事电力系统分析、运行与控制、新能源并网控制工作,871340366@qq.com;
, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1200799221952041079, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200799072731283881, xref=1., ext=[AuthorCompanyExt(id=1200799221960429687, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200799072731283881, companyId=1200799221952041079, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1.Power Dispatching and Control Center of Guizhou Power Grid Co. , Ltd. , Guiyang 550000, China), AuthorCompanyExt(id=1200799221977206904, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200799072731283881, companyId=1200799221952041079, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1.贵州电网公司电力调度控制中心,贵阳 550000)])]), Author(id=1200799222262419606, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200799072731283881, orderNo=1, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=liuwei3@csg.cn, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1200799222329528476, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200799072731283881, authorId=1200799222262419606, language=EN, stringName=Wei LIU, firstName=Wei, middleName=null, lastName=LIU, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=2, address=2.State Key Laboratory of HVDC, Electric Power Research Institute, CSG, Guangzhou 510663, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1200799222405025952, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200799072731283881, authorId=1200799222262419606, language=CN, stringName=刘蔚, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=2, address=2.直流输电技术全国重点实验室(南方电网科学研究院),广州 510663, bio={"content":"刘蔚(1974),男,通信作者,高级工程师,博士,从事交直流混合大电网仿真与计算分析工作,liuwei3@csg.cn;
"}, bioImg=null, bioContent=刘蔚(1974),男,通信作者,高级工程师,博士,从事交直流混合大电网仿真与计算分析工作,liuwei3@csg.cn;
, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1200799222023344252, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200799072731283881, xref=2., ext=[AuthorCompanyExt(id=1200799222031732860, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200799072731283881, companyId=1200799222023344252, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2.State Key Laboratory of HVDC, Electric Power Research Institute, CSG, Guangzhou 510663, China), AuthorCompanyExt(id=1200799222035927165, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200799072731283881, companyId=1200799222023344252, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2.直流输电技术全国重点实验室(南方电网科学研究院),广州 510663)])]), Author(id=1200799222455357606, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200799072731283881, orderNo=2, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=lms2800@qq.com, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1200799222505689259, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200799072731283881, authorId=1200799222455357606, language=EN, stringName=Mingshun LIU, firstName=Mingshun, middleName=null, lastName=LIU, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, address=1.Power Dispatching and Control Center of Guizhou Power Grid Co. , Ltd. , Guiyang 550000, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1200799222547632303, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200799072731283881, authorId=1200799222455357606, language=CN, stringName=刘明顺, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, address=1.贵州电网公司电力调度控制中心,贵阳 550000, bio={"content":"刘明顺(1986),男,高级工程师,硕士,从事电网分析、运行与控制工作,lms2800@qq.com。
"}, bioImg=null, bioContent=刘明顺(1986),男,高级工程师,硕士,从事电网分析、运行与控制工作,lms2800@qq.com。
, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1200799221952041079, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200799072731283881, xref=1., ext=[AuthorCompanyExt(id=1200799221960429687, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200799072731283881, companyId=1200799221952041079, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1.Power Dispatching and Control Center of Guizhou Power Grid Co. , Ltd. , Guiyang 550000, China), AuthorCompanyExt(id=1200799221977206904, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200799072731283881, companyId=1200799221952041079, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1.贵州电网公司电力调度控制中心,贵阳 550000)])]), Author(id=1200799222589575347, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200799072731283881, orderNo=3, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1200799222660878521, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200799072731283881, authorId=1200799222589575347, language=EN, stringName=Ye ZHANG, firstName=Ye, middleName=null, lastName=ZHANG, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=2, address=2.State Key Laboratory of HVDC, Electric Power Research Institute, CSG, Guangzhou 510663, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1200799222698627260, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200799072731283881, authorId=1200799222589575347, language=CN, stringName=张野, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=2, address=2.直流输电技术全国重点实验室(南方电网科学研究院),广州 510663, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1200799222023344252, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200799072731283881, xref=2., ext=[AuthorCompanyExt(id=1200799222031732860, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200799072731283881, companyId=1200799222023344252, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2.State Key Laboratory of HVDC, Electric Power Research Institute, CSG, Guangzhou 510663, China), AuthorCompanyExt(id=1200799222035927165, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200799072731283881, companyId=1200799222023344252, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2.直流输电技术全国重点实验室(南方电网科学研究院),广州 510663)])]), Author(id=1200799222744764609, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200799072731283881, orderNo=4, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1200799222832844999, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200799072731283881, authorId=1200799222744764609, language=EN, stringName=Yin WANG, firstName=Yin, middleName=null, lastName=WANG, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, address=1.Power Dispatching and Control Center of Guizhou Power Grid Co. , Ltd. , Guiyang 550000, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1200799222933508299, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200799072731283881, authorId=1200799222744764609, language=CN, stringName=王寅, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, address=1.贵州电网公司电力调度控制中心,贵阳 550000, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1200799221952041079, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200799072731283881, xref=1., ext=[AuthorCompanyExt(id=1200799221960429687, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200799072731283881, companyId=1200799221952041079, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1.Power Dispatching and Control Center of Guizhou Power Grid Co. , Ltd. , Guiyang 550000, China), AuthorCompanyExt(id=1200799221977206904, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200799072731283881, companyId=1200799221952041079, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1.贵州电网公司电力调度控制中心,贵阳 550000)])]), Author(id=1200799223004811473, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200799072731283881, orderNo=5, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1200799223046754517, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200799072731283881, authorId=1200799223004811473, language=EN, stringName=Wangqianyun TANG, firstName=Wangqianyun, middleName=null, lastName=TANG, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=2, address=2.State Key Laboratory of HVDC, Electric Power Research Institute, CSG, Guangzhou 510663, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1200799223105474779, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200799072731283881, authorId=1200799223004811473, language=CN, stringName=唐王倩云, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=2, address=2.直流输电技术全国重点实验室(南方电网科学研究院),广州 510663, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1200799222023344252, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200799072731283881, xref=2., ext=[AuthorCompanyExt(id=1200799222031732860, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200799072731283881, companyId=1200799222023344252, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2.State Key Laboratory of HVDC, Electric Power Research Institute, CSG, Guangzhou 510663, China), AuthorCompanyExt(id=1200799222035927165, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200799072731283881, companyId=1200799222023344252, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2.直流输电技术全国重点实验室(南方电网科学研究院),广州 510663)])])]
吴应双,刘蔚,刘明顺,张野,王寅,唐王倩云.
规模化新能源接入电网下的多区域协同算法[J].
南方电网技术, 2025, 19(9): 174-188 DOI:10.13648/j.cnki.issn1674-0629.2025.09.016
基金资助
国家自然科学基金青年科学基金资助项目(52207110)
中国南方电网有限责任公司科技项目(GZKJXM20222217)