基于状态-响应框架的有源配电网运行优化策略
-
胡柳君
1
,
-
董红
1
,
-
曾繁宏
1
,
-
张军
1
,
-
张勇军
1, 2
,
-
高毓群
1
作者信息
+
1.广东电网有限责任公司广州供电局,广州 510620
2.华南理工大学电力学院,广州 510640
|
胡柳君(1996),女,工程师,硕士,研究方向电力系统规划研究及系统分析,15116330584@163.com;
|
|
董红(1982),女,高级工程师,硕士,研究方向为电网规划、系统分析,donghong792@163.com;
|
|
曾繁宏(1994),男,工程师,硕士,研究方向为电力系统规划,1206868572@qq.com。
|
收起
Active Distribution Network Operation Optimization Strategies Based on State-Response Framework
Author information
+
1.Guangzhou Power Supply Bureau of Guangdong Power Grid Co. , Ltd. , Guangzhou 510620, China
2.School of Electric Power Engineering, South China University of Technology, Guangzhou 510640, China
Show less
文章历史
+
| 收稿日期 |
出版日期 |
| 2024-08-02 |
2025-06-20 |
PDF (2147K)
摘要
为提高配电网的运行效率和电压质量,结合深度强化学习和分布式广义快速对偶上升(SAC-GFD)算法,提出了一种基于状态-响应框架的优化策略。首先,利用软演员-评论家(soft actor-critic,SAC)算法将配电网运行优化问题建模为马尔可夫决策过程,智能体在含有可再生能源波动和负荷不确定性的环境中进行交互与探索,获得对不确定性环境具有鲁棒性控制策略。将配电网运行优化问题转化为马尔可夫决策过程,从而训练出能够快速输出配电网设备最优有功功率和无功功率的智能体。其次,计算当前配电网的潮流分布、节点电压状态以及有功功率和无功-电压灵敏度矩阵。然后,用户基于当前配电网状态,采用分布式方法计算自身负荷的最优调整值,确保配电网的安全运行。最后,在IEEE 33节点系统上的仿真结果表明,相较于传统的深度强化学习算法,所提算法能更有效地降低网络损耗和节点电压偏差,且具有更快的训练速度和更好的优化结果。
Abstract
In order to improve the operational efficiency and voltage quality of distribution networks, an optimization strategy is proposed based on a state-response framework, combining deep reinforcement learning with the distributed generalized fast dual ascent (SAC-GFD) algorithm. Firstly, the soft actor-critic (SAC) algorithm is employed to model the distribution network operation optimization problem as a Markov decision process (MDP). The agent interacts and explores in an environment with renewable energy fluctuations and load uncertainties, obtaining a control strategy that is robust to uncertain environments. The distribution network operation optimization problem is thus transformed into a Markov decision process, enabling the training of an agent capable of quickly outputting the optimal active and reactive power for distribution network equipment. Secondly, the current distribution network's power flow distribution, node voltage states, and active and reactive voltage sensitivity matrices are calculated. Then, based on the current state of the distribution network, users apply a distributed method to calculate their optimal load adjustments to ensure the safe operation of the network. Finally, the simulation results on the IEEE 33⁃node system demonstrate that compared to traditional deep reinforcement learning algorithms, the proposed method more effectively reduces network losses and node voltage deviations while achieving faster training speeds and better optimization results.
Graphical abstract
关键词
状态-响应
/
有源配电网
/
广义快速对偶上升法
/
软演员-评论家
/
深度强化学习
Key words
state-response
/
active distribution network
/
generalized fast dual ascent
/
soft actor-critic
/
deep reinforcement learning
[Author(id=1200502628388372482, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200502623233573823, orderNo=0, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=15116330584@163.com, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1200502628514201607, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200502623233573823, authorId=1200502628388372482, language=EN, stringName=Liujun HU, firstName=Liujun, middleName=null, lastName=HU, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, address=1.Guangzhou Power Supply Bureau of Guangdong Power Grid Co. , Ltd. , Guangzhou 510620, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1200502628644225034, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200502623233573823, authorId=1200502628388372482, language=CN, stringName=胡柳君, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, address=1.广东电网有限责任公司广州供电局,广州 510620, bio={"content":"胡柳君(1996),女,工程师,硕士,研究方向电力系统规划研究及系统分析,15116330584@163.com;
"}, bioImg=null, bioContent=胡柳君(1996),女,工程师,硕士,研究方向电力系统规划研究及系统分析,15116330584@163.com;
, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1200502628187046907, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200502623233573823, xref=1., ext=[AuthorCompanyExt(id=1200502628195435516, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200502623233573823, companyId=1200502628187046907, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1.Guangzhou Power Supply Bureau of Guangdong Power Grid Co. , Ltd. , Guangzhou 510620, China), AuthorCompanyExt(id=1200502628212212733, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200502623233573823, companyId=1200502628187046907, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1.广东电网有限责任公司广州供电局,广州 510620)])]), Author(id=1200502628740694031, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200502623233573823, orderNo=1, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=donghong792@163.com, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1200502628937826324, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200502623233573823, authorId=1200502628740694031, language=EN, stringName=Hong DONG, firstName=Hong, middleName=null, lastName=DONG, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, address=1.Guangzhou Power Supply Bureau of Guangdong Power Grid Co. , Ltd. , Guangzhou 510620, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1200502629072044054, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200502623233573823, authorId=1200502628740694031, language=CN, stringName=董红, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, address=1.广东电网有限责任公司广州供电局,广州 510620, bio={"content":"董红(1982),女,高级工程师,硕士,研究方向为电网规划、系统分析,donghong792@163.com;
"}, bioImg=null, bioContent=董红(1982),女,高级工程师,硕士,研究方向为电网规划、系统分析,donghong792@163.com;
, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1200502628187046907, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200502623233573823, xref=1., ext=[AuthorCompanyExt(id=1200502628195435516, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200502623233573823, companyId=1200502628187046907, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1.Guangzhou Power Supply Bureau of Guangdong Power Grid Co. , Ltd. , Guangzhou 510620, China), AuthorCompanyExt(id=1200502628212212733, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200502623233573823, companyId=1200502628187046907, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1.广东电网有限责任公司广州供电局,广州 510620)])]), Author(id=1200502629185290264, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200502623233573823, orderNo=2, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=1206868572@qq.com, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1200502629298536475, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200502623233573823, authorId=1200502629185290264, language=EN, stringName=Fanhong ZENG, firstName=Fanhong, middleName=null, lastName=ZENG, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, address=1.Guangzhou Power Supply Bureau of Guangdong Power Grid Co. , Ltd. , Guangzhou 510620, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1200502629395005470, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200502623233573823, authorId=1200502629185290264, language=CN, stringName=曾繁宏, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, address=1.广东电网有限责任公司广州供电局,广州 510620, bio={"content":"曾繁宏(1994),男,工程师,硕士,研究方向为电力系统规划,1206868572@qq.com。
"}, bioImg=null, bioContent=曾繁宏(1994),男,工程师,硕士,研究方向为电力系统规划,1206868572@qq.com。
, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1200502628187046907, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200502623233573823, xref=1., ext=[AuthorCompanyExt(id=1200502628195435516, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200502623233573823, companyId=1200502628187046907, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1.Guangzhou Power Supply Bureau of Guangdong Power Grid Co. , Ltd. , Guangzhou 510620, China), AuthorCompanyExt(id=1200502628212212733, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200502623233573823, companyId=1200502628187046907, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1.广东电网有限责任公司广州供电局,广州 510620)])]), Author(id=1200502629462114338, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200502623233573823, orderNo=3, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1200502629600526376, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200502623233573823, authorId=1200502629462114338, language=EN, stringName=Jun ZHANG, firstName=Jun, middleName=null, lastName=ZHANG, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, address=1.Guangzhou Power Supply Bureau of Guangdong Power Grid Co. , Ltd. , Guangzhou 510620, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1200502629713772587, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200502623233573823, authorId=1200502629462114338, language=CN, stringName=张军, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, address=1.广东电网有限责任公司广州供电局,广州 510620, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1200502628187046907, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200502623233573823, xref=1., ext=[AuthorCompanyExt(id=1200502628195435516, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200502623233573823, companyId=1200502628187046907, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1.Guangzhou Power Supply Bureau of Guangdong Power Grid Co. , Ltd. , Guangzhou 510620, China), AuthorCompanyExt(id=1200502628212212733, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200502623233573823, companyId=1200502628187046907, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1.广东电网有限责任公司广州供电局,广州 510620)])]), Author(id=1200502629806047280, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200502623233573823, orderNo=4, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1200502629910904886, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200502623233573823, authorId=1200502629806047280, language=EN, stringName=Yongjun ZHANG, firstName=Yongjun, middleName=null, lastName=ZHANG, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, 2, address=1.Guangzhou Power Supply Bureau of Guangdong Power Grid Co. , Ltd. , Guangzhou 510620, China
2.School of Electric Power Engineering, South China University of Technology, Guangzhou 510640, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1200502630045122617, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200502623233573823, authorId=1200502629806047280, language=CN, stringName=张勇军, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, 2, address=1.广东电网有限责任公司广州供电局,广州 510620
2.华南理工大学电力学院,广州 510640, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1200502628187046907, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200502623233573823, xref=1., ext=[AuthorCompanyExt(id=1200502628195435516, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200502623233573823, companyId=1200502628187046907, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1.Guangzhou Power Supply Bureau of Guangdong Power Grid Co. , Ltd. , Guangzhou 510620, China), AuthorCompanyExt(id=1200502628212212733, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200502623233573823, companyId=1200502628187046907, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1.广东电网有限责任公司广州供电局,广州 510620)]), AuthorCompany(id=1200502628283515902, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200502623233573823, xref=2., ext=[AuthorCompanyExt(id=1200502628291904511, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200502623233573823, companyId=1200502628283515902, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2.School of Electric Power Engineering, South China University of Technology, Guangzhou 510640, China), AuthorCompanyExt(id=1200502628312876032, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200502623233573823, companyId=1200502628283515902, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2.华南理工大学电力学院,广州 510640)])]), Author(id=1200502630124814396, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200502623233573823, orderNo=5, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1200502630208700481, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200502623233573823, authorId=1200502630124814396, language=EN, stringName=Yuqun GAO, firstName=Yuqun, middleName=null, lastName=GAO, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, address=1.Guangzhou Power Supply Bureau of Guangdong Power Grid Co. , Ltd. , Guangzhou 510620, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1200502630267420739, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200502623233573823, authorId=1200502630124814396, language=CN, stringName=高毓群, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, address=1.广东电网有限责任公司广州供电局,广州 510620, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1200502628187046907, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200502623233573823, xref=1., ext=[AuthorCompanyExt(id=1200502628195435516, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200502623233573823, companyId=1200502628187046907, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1.Guangzhou Power Supply Bureau of Guangdong Power Grid Co. , Ltd. , Guangzhou 510620, China), AuthorCompanyExt(id=1200502628212212733, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200502623233573823, companyId=1200502628187046907, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1.广东电网有限责任公司广州供电局,广州 510620)])])]
胡柳君,董红,曾繁宏,张军,张勇军,高毓群.
基于状态-响应框架的有源配电网运行优化策略[J].
南方电网技术, 2025, 19(6): 62-71 DOI:10.13648/j.cnki.issn1674-0629.2025.06.006