Two-timescale voltage regulation in distribution grids using deep reinforcement learning

Qiuling Yang, Gang Wang, Alireza Sadeghi, Georgios B. Giannakis, Jian Sun

Research output: Chapter in Book/Report/Conference proceedingConference contribution

4 Scopus citations

Abstract

Frequent and sizeable voltage fluctuations become more pronounced with the increasing penetration of distributed renewable generation, and they considerably challenge distribution grids. Voltage regulation schemes so far have relied on either utility-owned devices (e.g., voltage transformers, and shunt capacitors), or more recently, smart power inverters that come with contemporary distributed generation units (e.g., photovoltaic systems, and wind turbines). Nonetheless, due to the distinct response times of those devices, as well as the discrete on-off commitment of capacitor units, joint control of both types of assets is challenging. In this context, a novel two-timescale voltage regulation scheme is developed here by coupling optimization with reinforcement learning advances. Shunt capacitors are configured on a slow timescale (e.g., daily basis) leveraging a deep reinforcement learning algorithm, while optimal setpoints of the power inverters are computed using a linearized distribution flow model on a fast timescale (e.g., every few seconds or minutes). Numerical experiments using a real-world 47-bus distribution feeder showcase the remarkable performance of the novel scheme.

Original languageEnglish (US)
Title of host publication2019 IEEE International Conference on Communications, Control, and Computing Technologies for Smart Grids, SmartGridComm 2019
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781538680995
DOIs
StatePublished - Oct 2019
Event2019 IEEE International Conference on Communications, Control, and Computing Technologies for Smart Grids, SmartGridComm 2019 - Beijing, China
Duration: Oct 21 2019Oct 23 2019

Publication series

Name2019 IEEE International Conference on Communications, Control, and Computing Technologies for Smart Grids, SmartGridComm 2019

Conference

Conference2019 IEEE International Conference on Communications, Control, and Computing Technologies for Smart Grids, SmartGridComm 2019
CountryChina
CityBeijing
Period10/21/1910/23/19

Bibliographical note

Funding Information:
The work of Q. Yang and J. Sun was supported in part by the National Natural Science Foundation of China under Grants 61621063, 61522303, 61720106011, 61621063, and in part by the Program for Changjiang Scholars and Innovative Research Team in University (IRT1208). Q. Yang was also supported by the China Scholarship Council. The work of G. Wang, A. Sadeghi, and G. B. Giannakis was supported in part by the National Science Foundation under Grants 1508993, 1509040, and 1711471.

Keywords

  • Capacitor
  • Deep reinforcement learning.
  • Inverter
  • Two-timescale
  • Voltage regulation

Fingerprint Dive into the research topics of 'Two-timescale voltage regulation in distribution grids using deep reinforcement learning'. Together they form a unique fingerprint.

Cite this