Frequent and sizeable voltage fluctuations become more pronounced with the increasing penetration of distributed renewable generation, and they considerably challenge distribution grids. Voltage regulation schemes so far have relied on either utility-owned devices (e.g., voltage transformers, and shunt capacitors), or more recently, smart power inverters that come with contemporary distributed generation units (e.g., photovoltaic systems, and wind turbines). Nonetheless, due to the distinct response times of those devices, as well as the discrete on-off commitment of capacitor units, joint control of both types of assets is challenging. In this context, a novel two-timescale voltage regulation scheme is developed here by coupling optimization with reinforcement learning advances. Shunt capacitors are configured on a slow timescale (e.g., daily basis) leveraging a deep reinforcement learning algorithm, while optimal setpoints of the power inverters are computed using a linearized distribution flow model on a fast timescale (e.g., every few seconds or minutes). Numerical experiments using a real-world 47-bus distribution feeder showcase the remarkable performance of the novel scheme.
|Original language||English (US)|
|Title of host publication||2019 IEEE International Conference on Communications, Control, and Computing Technologies for Smart Grids, SmartGridComm 2019|
|Publisher||Institute of Electrical and Electronics Engineers Inc.|
|State||Published - Oct 2019|
|Event||2019 IEEE International Conference on Communications, Control, and Computing Technologies for Smart Grids, SmartGridComm 2019 - Beijing, China|
Duration: Oct 21 2019 → Oct 23 2019
|Name||2019 IEEE International Conference on Communications, Control, and Computing Technologies for Smart Grids, SmartGridComm 2019|
|Conference||2019 IEEE International Conference on Communications, Control, and Computing Technologies for Smart Grids, SmartGridComm 2019|
|Period||10/21/19 → 10/23/19|
Bibliographical noteFunding Information:
The work of Q. Yang and J. Sun was supported in part by the National Natural Science Foundation of China under Grants 61621063, 61522303, 61720106011, 61621063, and in part by the Program for Changjiang Scholars and Innovative Research Team in University (IRT1208). Q. Yang was also supported by the China Scholarship Council. The work of G. Wang, A. Sadeghi, and G. B. Giannakis was supported in part by the National Science Foundation under Grants 1508993, 1509040, and 1711471.
© 2019 IEEE.
- Deep reinforcement learning.
- Voltage regulation