基于改进TD3的农村微电网源网荷储优化运行策略
-
陈国齐
1
,
-
魏颖豪
1
,
-
刘毅
1
,
-
李梦锐
1
,
-
熊马超
1
,
-
王灿
2
作者信息
+
1.国网湖北省电力有限公司荆州供电公司,湖北 荆州 431700
2.三峡大学电气与新能源学院,湖北 宜昌 443002
|
陈国齐(1992),男,工程师,硕士,研究方向为微电网优化调度,516503824@qq.com;
|
|
魏颖豪(1984),男,高级工程师,硕士,研究方向为微电网能量管理,yinghao2586@163.com;
|
|
王灿(1987),通信作者,男,副教授,博士,研究方向为微电网优化运行与控制,xfcancan@163.com。
|
收起
Optimal Operation Strategy for Source-Grid-Load-Storage in Rural Microgrids Based on Improved TD3
Author information
+
1.Jingzhou Power Supply Company, State Grid Hubei Electric Power Co. , Ltd. , Jingzhou, Hubei 431700, China
2.College of Electrical Engineering and New Energy, China Three Gorges University, Yichang, Hubei 443002, China
Show less
文章历史
+
| 收稿日期 |
出版日期 |
| 2026-01-26 |
2026-08-20 |
PDF (3160K)
摘要
农村微电网作为支撑“双碳”目标落地、赋能乡村振兴战略实施的重要载体,通过整合分布式能源与传统发电资源,能够有效提升系统整体的运行效率。为此,提出了一种基于改进双延迟深度确定性策略梯度(twin delayed deep deterministic policy gradient,TD3)的农村微电网源网荷储优化运行策略。首先,综合考虑运行成本和可再生能源利用率,构建了含沼气的农村微电网源网荷储优化运行模型。其次,构建了基于复合评分机制的注意力加权评论家网络(CASA-Critic),动态提取并聚焦关键状态特征以提升价值网络的评估精度。然后,采用动态感知策略,基于训练阶段在时间进程与环境状态的不确定性特征动态调节动作探索强度,改善算法在探索与利用之间的平衡。最后,基于典型的农村微网源网荷储运行场景进行仿真分析,仿真结果表明,相较于其他基于深度强化学习的优化运行策略,所提方法具有更好的收敛性和寻优效果,在提升系统运行经济性、促进可再生能源消纳方面具有明显的优越性。
Abstract
As a crucial carrier for supporting the implementation of the "dual carbon" goals and empowering rural revitalization, rural microgrids can effectively enhance overall system operational efficiency by integrating distributed energy with traditional power generation resources. To this end, this paper proposes a optimal operation strategy for source-grid-load-storage in rural microgrids based on an improved twin delayed deep deterministic policy gradient (TD3) algorithm. Firstly, an optimal operation model for rural microgrids incorporating biogas is constructed by comprehensively considering operating costs and renewable energy utilization. Secondly, a compound assessment scored attention-weighted critic(CASA-Critic)is designed to dynamically extract and focus on key state features, thereby enhancing the evaluation accuracy of the value network. Then, a dynamic perception strategy is introduced to adaptively adjust the intensity of action exploration based on the temporal progression and environmental state uncertainties during training, improving the balance between exploration and exploitation. Finally, simulation analysis is conducted based on a typical rural microgrids source-grid-load-storage operation scenario. The results demonstrate that, compared to optimization strategies based on other deep reinforcement learning, the proposed method exhibits better convergence and optimization performance, while also showing significant superiority in improving system operational economy and promoting renewable energy accommodation.
Graphical abstract
关键词
农村微电网
/
深度强化学习
/
动态感知策略
/
注意力加权评论家网络
/
优化运行
Key words
rural microgrid
/
deep reinforcement learning
/
dynamic perception strategy
/
CASA-critic
/
optimal operation
Author summay
[Author(id=1304381934218326905, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1304381914777727550, orderNo=0, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=516503824@qq.com, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1304381934369321854, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1304381914777727550, authorId=1304381934218326905, language=EN, stringName=Guoqi CHEN, firstName=Guoqi, middleName=null, lastName=CHEN, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, address=1.Jingzhou Power Supply Company, State Grid Hubei Electric Power Co. , Ltd. , Jingzhou, Hubei 431700, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1304381934453207941, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1304381914777727550, authorId=1304381934218326905, language=CN, stringName=陈国齐, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, address=1.国网湖北省电力有限公司荆州供电公司,湖北 荆州 431700, bio={"content":"陈国齐(1992),男,工程师,硕士,研究方向为微电网优化调度,516503824@qq.com;
"}, bioImg=null, bioContent=陈国齐(1992),男,工程师,硕士,研究方向为微电网优化调度,516503824@qq.com;
, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1304381933899559780, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1304381914777727550, xref=1., ext=[AuthorCompanyExt(id=1304381933907948389, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1304381914777727550, companyId=1304381933899559780, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1.Jingzhou Power Supply Company, State Grid Hubei Electric Power Co. , Ltd. , Jingzhou, Hubei 431700, China), AuthorCompanyExt(id=1304381934033777514, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1304381914777727550, companyId=1304381933899559780, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1.国网湖北省电力有限公司荆州供电公司,湖北 荆州 431700)])]), Author(id=1304381934520316809, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1304381914777727550, orderNo=1, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=yinghao2586@163.com, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1304381934574842765, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1304381914777727550, authorId=1304381934520316809, language=EN, stringName=Yinghao WEI, firstName=Yinghao, middleName=null, lastName=WEI, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, address=1.Jingzhou Power Supply Company, State Grid Hubei Electric Power Co. , Ltd. , Jingzhou, Hubei 431700, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1304381934616785807, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1304381914777727550, authorId=1304381934520316809, language=CN, stringName=魏颖豪, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, address=1.国网湖北省电力有限公司荆州供电公司,湖北 荆州 431700, bio={"content":"魏颖豪(1984),男,高级工程师,硕士,研究方向为微电网能量管理,yinghao2586@163.com;
"}, bioImg=null, bioContent=魏颖豪(1984),男,高级工程师,硕士,研究方向为微电网能量管理,yinghao2586@163.com;
, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1304381933899559780, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1304381914777727550, xref=1., ext=[AuthorCompanyExt(id=1304381933907948389, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1304381914777727550, companyId=1304381933899559780, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1.Jingzhou Power Supply Company, State Grid Hubei Electric Power Co. , Ltd. , Jingzhou, Hubei 431700, China), AuthorCompanyExt(id=1304381934033777514, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1304381914777727550, companyId=1304381933899559780, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1.国网湖北省电力有限公司荆州供电公司,湖北 荆州 431700)])]), Author(id=1304381934650340243, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1304381914777727550, orderNo=2, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1304381934683894678, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1304381914777727550, authorId=1304381934650340243, language=EN, stringName=Yi LIU, firstName=Yi, middleName=null, lastName=LIU, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, address=1.Jingzhou Power Supply Company, State Grid Hubei Electric Power Co. , Ltd. , Jingzhou, Hubei 431700, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1304381934855861158, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1304381914777727550, authorId=1304381934650340243, language=CN, stringName=刘毅, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, address=1.国网湖北省电力有限公司荆州供电公司,湖北 荆州 431700, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1304381933899559780, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1304381914777727550, xref=1., ext=[AuthorCompanyExt(id=1304381933907948389, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1304381914777727550, companyId=1304381933899559780, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1.Jingzhou Power Supply Company, State Grid Hubei Electric Power Co. , Ltd. , Jingzhou, Hubei 431700, China), AuthorCompanyExt(id=1304381934033777514, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1304381914777727550, companyId=1304381933899559780, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1.国网湖北省电力有限公司荆州供电公司,湖北 荆州 431700)])]), Author(id=1304381934910387117, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1304381914777727550, orderNo=3, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1304381934952330162, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1304381914777727550, authorId=1304381934910387117, language=EN, stringName=Mengrui LI, firstName=Mengrui, middleName=null, lastName=LI, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, address=1.Jingzhou Power Supply Company, State Grid Hubei Electric Power Co. , Ltd. , Jingzhou, Hubei 431700, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1304381935002661812, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1304381914777727550, authorId=1304381934910387117, language=CN, stringName=李梦锐, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, address=1.国网湖北省电力有限公司荆州供电公司,湖北 荆州 431700, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1304381933899559780, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1304381914777727550, xref=1., ext=[AuthorCompanyExt(id=1304381933907948389, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1304381914777727550, companyId=1304381933899559780, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1.Jingzhou Power Supply Company, State Grid Hubei Electric Power Co. , Ltd. , Jingzhou, Hubei 431700, China), AuthorCompanyExt(id=1304381934033777514, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1304381914777727550, companyId=1304381933899559780, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1.国网湖北省电力有限公司荆州供电公司,湖北 荆州 431700)])]), Author(id=1304381935040410551, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1304381914777727550, orderNo=4, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1304381935090742202, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1304381914777727550, authorId=1304381935040410551, language=EN, stringName=Machao XIONG, firstName=Machao, middleName=null, lastName=XIONG, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, address=1.Jingzhou Power Supply Company, State Grid Hubei Electric Power Co. , Ltd. , Jingzhou, Hubei 431700, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1304381935128490943, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1304381914777727550, authorId=1304381935040410551, language=CN, stringName=熊马超, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, address=1.国网湖北省电力有限公司荆州供电公司,湖北 荆州 431700, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1304381933899559780, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1304381914777727550, xref=1., ext=[AuthorCompanyExt(id=1304381933907948389, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1304381914777727550, companyId=1304381933899559780, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1.Jingzhou Power Supply Company, State Grid Hubei Electric Power Co. , Ltd. , Jingzhou, Hubei 431700, China), AuthorCompanyExt(id=1304381934033777514, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1304381914777727550, companyId=1304381933899559780, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1.国网湖北省电力有限公司荆州供电公司,湖北 荆州 431700)])]), Author(id=1304381935224959944, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1304381914777727550, orderNo=5, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=xfcancan@163.com, emailSecond=null, emailThird=null, correspondingAuthor=1, authorType=1, ext={EN=AuthorExt(id=1304381935329817552, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1304381914777727550, authorId=1304381935224959944, language=EN, stringName=Can WANG, firstName=Can, middleName=null, lastName=WANG, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=2, address=2.College of Electrical Engineering and New Energy, China Three Gorges University, Yichang, Hubei 443002, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1304381935409509338, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1304381914777727550, authorId=1304381935224959944, language=CN, stringName=王灿, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=2, address=2.三峡大学电气与新能源学院,湖北 宜昌 443002, bio={"content":"王灿(1987),通信作者,男,副教授,博士,研究方向为微电网优化运行与控制,xfcancan@163.com。
"}, bioImg=null, bioContent=王灿(1987),通信作者,男,副教授,博士,研究方向为微电网优化运行与控制,xfcancan@163.com。
, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1304381934121857905, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1304381914777727550, xref=2., ext=[AuthorCompanyExt(id=1304381934138635124, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1304381914777727550, companyId=1304381934121857905, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2.College of Electrical Engineering and New Energy, China Three Gorges University, Yichang, Hubei 443002, China), AuthorCompanyExt(id=1304381934180578166, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1304381914777727550, companyId=1304381934121857905, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2.三峡大学电气与新能源学院,湖北 宜昌 443002)])])]
陈国齐,魏颖豪,刘毅,李梦锐,熊马超,王灿.
基于改进TD3的农村微电网源网荷储优化运行策略[J].
南方电网技术, 2026, 20(8): 89-103 DOI:10.13648/j.cnki.issn1674-0629.2026.08.008
基金资助
国家自然科学基金资助项目(5237791)