Day-Ahead and Intra-Day Coordinated Optimal Scheduling of Microgrid Based on Deep Reinforcement Learning

Yuhan XU , Tianyao JI , Mengshi LI

›› 2024, Vol. 18 ›› Issue (9) : 106 -116.

PDF
›› 2024, Vol. 18 ›› Issue (9) : 106 -116. DOI: 10.13648/j.cnki.issn1674-0629.2024.09.012
research-article

Day-Ahead and Intra-Day Coordinated Optimal Scheduling of Microgrid Based on Deep Reinforcement Learning

Author information +
History +
PDF

Abstract

Due to the randomness of renewable energy generation and the time series coupling characteristics of energy storage systems, it is necessary to properly model uncertain variables and develop optimization algorithms that can efficiently handle multi-objective problems when constructing economic scheduling models for microgrids. In this context, an efficient multi-time scale dispatching method for microgrids based on deep reinforcement learning and heuristic algorithms is proposed, which can take into account uncertain factors and achieve economic and environmental protection operation. The proposed method optimizes the microgrid from two time scales: day-ahead and intra-day. The day-ahead optimization phase utilizes short-term forecast data for initial decision making to minimize the operating cost. For the intra-day dispatching phase, it utilizes the day-ahead optimization scheme as a reference and revises the day-ahead operation scheme if necessary to cope with the real-time fluctuations of renewable energy. The process of intra-day optimization is decoupled into global and local two phases, the global stage is modeled as a non-convex nonlinear optimization problem and solved using heuristic algorithms, while the local stage is modeled as a Markov decision process and solved using deep reinforcement learning methods. Combining deep reinforcement learning with heuristic algorithms improves the training speed and convergence performance of reinforcement learning, avoiding the difficulty of designing reward functions in complex environments. Finally, the case analysis verifies that the proposed scheme achieves optimization of scheduling cost and computing speed, and is suitable for real-time scheduling of microgrids.

Keywords

microgrid / group search algorithm / deep reinforcement learning / economic scheduling / multi-time scale

Cite this article

Download citation ▾
Yuhan XU,Tianyao JI,Mengshi LI. Day-Ahead and Intra-Day Coordinated Optimal Scheduling of Microgrid Based on Deep Reinforcement Learning. 2024, 18(9): 106-116 DOI:10.13648/j.cnki.issn1674-0629.2024.09.012

登录浏览全文

4963

注册一个新账户 忘记密码

References

Funding

the National Natural Science Foundation of China(52104149)

PDF

7

Accesses

0

Citation

Detail

Sections
Recommended

AI思维导图

/