基于多智能体近端策略网络的数据中心双层优化调度
-
杨秀
1
,
-
张相寅
1
,
-
黄海涛
1
,
-
余文昶
2
,
-
陈永刚
2
,
-
曹俊波
2
作者信息
+
1.上海电力大学电气工程学院,上海 200090
2.中国华电集团有限公司上海分公司,上海 200120
|
杨秀(1972),男,教授,博士,从事分布式发电与微电网技术、主动配电网与能源互联网运行仿真研究,angxiu721102@126.com;
|
|
张相寅(1999),男,通信作者,硕士研究生,研究方向为数据中心负荷响应特性及优化调度,2271098983@qq.com;
|
|
黄海涛(1978),女,教授,博士,研究方向为电力市场和能源互联,hbdl_huanghaitao@sina.com。
|
收起
Dual-Layer Optimization Scheduling of Data Center Based on Multi-Agent Proximal Strategy Network
Author information
+
1.School of Electrical Engineering, Shanghai University of Electric Power, Shanghai 200090, China
2.Shanghai Branch of China Huadian Group Co. , Ltd. , Shanghai 200120, China
Show less
文章历史
+
| 收稿日期 |
出版日期 |
| 2023-12-04 |
2025-04-20 |
PDF (4394K)
摘要
随着新一代信息通信技术,如5G、云计算和人工智能的不断演进,世界正迅速迈入数字经济的快车道。针对数据中心中可再生能源和工作负载预测的不确定性,提出了一种基于多智能体近端策略网络的数据中心双层优化调度方法。首先,建立了数据中心双层时空优化调度框架,对数据中心工作负载、IT设备、空调设备进行详细建模;在此基础上,提出数据中心的双层优化调度模型,上层以互联网数据中心(Internet data center,IDC)运营管理商总运营成本最小为目标进行时间维度调度,下层以各IDC运行成本最低为目标进行空间维度调度;然后,介绍多智能体近端策略网络算法原理,设计数据中心双层优化调度模型的状态空间、动作空间和奖励函数。最后,针对算例进行离线训练和在线调度决策,仿真结果表明,所提模型和方法能够有效降低系统成本和能耗,实现工作负载的最佳分配,具有较好的经济性和鲁棒性。
Abstract
With the continuous evolution of new generation information and communication technologies such as 5G, cloud computing, and artificial intelligence, the world is rapidly entering the fast lane of the digital economy. A dual-layer optimization scheduling method for data centers based on multi-agent proximal strategy network is proposed to address the uncertainty of renewable energy and workload prediction in data centers. Firstly, a dual-layer spatiotemporal optimization scheduling framework for data centers is established, which provides detailed modeling of data center workloads, IT equipment, and air conditioning equipment; On this basis, a dual-layer optimization scheduling model for data centers is proposed. The upper layer schedules the time dimension with the goal of minimizing the total operating cost of IDC operators, while the lower layer schedules the space dimension with the goal of minimizing the operating cost of each IDC. Then, the principle of multi-agent proximal strategy network algorithm is introduced, and the state space, action space, and reward function of the dual-layer optimization scheduling model for data centers are designed. Finally, offline training and online scheduling decisions are conducted for the examples. Simulation results show that the proposed model and method can effectively reduce system costs and energy consumption, achieve optimal workload allocation, and have good economy and robustness.
Graphical abstract
关键词
多智能体
/
工作负载分配
/
时空调度
/
近端策略优化
/
数据中心
Key words
multi-agent
/
workload allocation
/
spatiotemporal scheduling
/
proximal strategy optimization
/
data center
[Author(id=1200813084386803718, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200813068498780729, orderNo=0, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=angxiu721102@126.com, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1200813084428746762, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200813068498780729, authorId=1200813084386803718, language=EN, stringName=Xiu YANG, firstName=Xiu, middleName=null, lastName=YANG, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, address=1.School of Electrical Engineering, Shanghai University of Electric Power, Shanghai 200090, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1200813084466495504, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200813068498780729, authorId=1200813084386803718, language=CN, stringName=杨秀, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, address=1.上海电力大学电气工程学院,上海 200090, bio={"content":"杨秀(1972),男,教授,博士,从事分布式发电与微电网技术、主动配电网与能源互联网运行仿真研究,angxiu721102@126.com;
"}, bioImg=null, bioContent=杨秀(1972),男,教授,博士,从事分布式发电与微电网技术、主动配电网与能源互联网运行仿真研究,angxiu721102@126.com;
, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1200813084265169916, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200813068498780729, xref=1., ext=[AuthorCompanyExt(id=1200813084269364221, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200813068498780729, companyId=1200813084265169916, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1.School of Electrical Engineering, Shanghai University of Electric Power, Shanghai 200090, China), AuthorCompanyExt(id=1200813084286141438, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200813068498780729, companyId=1200813084265169916, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1.上海电力大学电气工程学院,上海 200090)])]), Author(id=1200813084516827160, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200813068498780729, orderNo=1, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=2271098983@qq.com, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1200813084558770205, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200813068498780729, authorId=1200813084516827160, language=EN, stringName=Xiangyin ZHANG, firstName=Xiangyin, middleName=null, lastName=ZHANG, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, address=1.School of Electrical Engineering, Shanghai University of Electric Power, Shanghai 200090, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1200813084642656289, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200813068498780729, authorId=1200813084516827160, language=CN, stringName=张相寅, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, address=1.上海电力大学电气工程学院,上海 200090, bio={"content":"张相寅(1999),男,通信作者,硕士研究生,研究方向为数据中心负荷响应特性及优化调度,2271098983@qq.com;
"}, bioImg=null, bioContent=张相寅(1999),男,通信作者,硕士研究生,研究方向为数据中心负荷响应特性及优化调度,2271098983@qq.com;
, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1200813084265169916, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200813068498780729, xref=1., ext=[AuthorCompanyExt(id=1200813084269364221, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200813068498780729, companyId=1200813084265169916, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1.School of Electrical Engineering, Shanghai University of Electric Power, Shanghai 200090, China), AuthorCompanyExt(id=1200813084286141438, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200813068498780729, companyId=1200813084265169916, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1.上海电力大学电气工程学院,上海 200090)])]), Author(id=1200813084705570855, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200813068498780729, orderNo=2, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=hbdl_huanghaitao@sina.com, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1200813084747513898, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200813068498780729, authorId=1200813084705570855, language=EN, stringName=Haitao HUANG, firstName=Haitao, middleName=null, lastName=HUANG, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, address=1.School of Electrical Engineering, Shanghai University of Electric Power, Shanghai 200090, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1200813084802039854, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200813068498780729, authorId=1200813084705570855, language=CN, stringName=黄海涛, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, address=1.上海电力大学电气工程学院,上海 200090, bio={"content":"黄海涛(1978),女,教授,博士,研究方向为电力市场和能源互联,hbdl_huanghaitao@sina.com。
"}, bioImg=null, bioContent=黄海涛(1978),女,教授,博士,研究方向为电力市场和能源互联,hbdl_huanghaitao@sina.com。
, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1200813084265169916, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200813068498780729, xref=1., ext=[AuthorCompanyExt(id=1200813084269364221, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200813068498780729, companyId=1200813084265169916, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1.School of Electrical Engineering, Shanghai University of Electric Power, Shanghai 200090, China), AuthorCompanyExt(id=1200813084286141438, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200813068498780729, companyId=1200813084265169916, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1.上海电力大学电气工程学院,上海 200090)])]), Author(id=1200813084839788596, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200813068498780729, orderNo=3, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1200813084885925945, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200813068498780729, authorId=1200813084839788596, language=EN, stringName=Wenchang YU, firstName=Wenchang, middleName=null, lastName=YU, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=2, address=2.Shanghai Branch of China Huadian Group Co. , Ltd. , Shanghai 200120, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1200813084919480382, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200813068498780729, authorId=1200813084839788596, language=CN, stringName=余文昶, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=2, address=2.中国华电集团有限公司上海分公司,上海 200120, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1200813084349054976, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200813068498780729, xref=2., ext=[AuthorCompanyExt(id=1200813084353249281, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200813068498780729, companyId=1200813084349054976, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2.Shanghai Branch of China Huadian Group Co. , Ltd. , Shanghai 200120, China), AuthorCompanyExt(id=1200813084357443587, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200813068498780729, companyId=1200813084349054976, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2.中国华电集团有限公司上海分公司,上海 200120)])]), Author(id=1200813084982394947, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200813068498780729, orderNo=4, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1200813085066281034, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200813068498780729, authorId=1200813084982394947, language=EN, stringName=Yonggang CHEN, firstName=Yonggang, middleName=null, lastName=CHEN, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=2, address=2.Shanghai Branch of China Huadian Group Co. , Ltd. , Shanghai 200120, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1200813085104029774, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200813068498780729, authorId=1200813084982394947, language=CN, stringName=陈永刚, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=2, address=2.中国华电集团有限公司上海分公司,上海 200120, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1200813084349054976, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200813068498780729, xref=2., ext=[AuthorCompanyExt(id=1200813084353249281, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200813068498780729, companyId=1200813084349054976, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2.Shanghai Branch of China Huadian Group Co. , Ltd. , Shanghai 200120, China), AuthorCompanyExt(id=1200813084357443587, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200813068498780729, companyId=1200813084349054976, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2.中国华电集团有限公司上海分公司,上海 200120)])]), Author(id=1200813085145972818, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200813068498780729, orderNo=5, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1200813085175332950, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200813068498780729, authorId=1200813085145972818, language=EN, stringName=Junbo CAO, firstName=Junbo, middleName=null, lastName=CAO, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=2, address=2.Shanghai Branch of China Huadian Group Co. , Ltd. , Shanghai 200120, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1200813085204693080, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200813068498780729, authorId=1200813085145972818, language=CN, stringName=曹俊波, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=2, address=2.中国华电集团有限公司上海分公司,上海 200120, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1200813084349054976, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200813068498780729, xref=2., ext=[AuthorCompanyExt(id=1200813084353249281, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200813068498780729, companyId=1200813084349054976, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2.Shanghai Branch of China Huadian Group Co. , Ltd. , Shanghai 200120, China), AuthorCompanyExt(id=1200813084357443587, tenantId=1150419971270848770, journalId=1150420108982431745, articleId=1200813068498780729, companyId=1200813084349054976, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2.中国华电集团有限公司上海分公司,上海 200120)])])]
杨秀,张相寅,黄海涛,余文昶,陈永刚,曹俊波.
基于多智能体近端策略网络的数据中心双层优化调度[J].
南方电网技术, 2025, 19(4): 107-121 DOI:10.13648/j.cnki.issn1674-0629.2025.04.009
基金资助
国家自然科学基金资助项目(52207121)