Ebell N, Heinrich F, Schlund J, Pruckner M (2018)
Publication Language: English
Publication Type: Conference contribution, Conference Contribution
Publication year: 2018
Pages Range: 1-6
Conference Proceedings Title: 2018 IEEE International Conference on Communications, Control, and Computing Technologies for Smart Grids (SmartGridComm)
ISBN: 978-1-5386-7954-8
DOI: 10.1109/SmartGridComm.2018.8587480
Rooftop-installed photovoltaic systems for residential buildings with battery energy storage system are increasing. Controlling power flows of volatile and unpredictable renewable energy sources in such a system is challenging. Therefore, in this paper we present an algorithm based on Reinforcement Learning to control the power flows of a residential household with a battery energy storage system and a photovoltaic system using neural networks as a function approximation. In a nondeterministic environment the optimal choice of a series of actions to be taken is complex. Training a Reinforcement Learning algorithm, these complex patterns can be learned. The task of the energy storage is to reduce the energy feedin to the electric grid as well as to improve power system stability by providing frequency containment reserve power to the transmission system operator. Our model includes the profiles of the grid’s frequency, photovoltaic power generation and the electric load of two different households for one year. The first household is used to train the algorithm and to adjust the weights of the neural network to estimate the state-action values. The second household is used to test the functionality of the algorithm on unseen data. To evaluate the behavior of the Reinforcement Learning algorithm the results are compared to a simulation of rule-based control. As a result, after 300 episodes of training, the algorithm is able to reduce the energy consumption from the grid up to 7:8% compared to the rule-based control system managing the system’s power flows.
APA:
Ebell, N., Heinrich, F., Schlund, J., & Pruckner, M. (2018). Reinforcement Learning Control Algorithm for a PV-Battery-System Providing Frequency Containment Reserve Power. In 2018 IEEE International Conference on Communications, Control, and Computing Technologies for Smart Grids (SmartGridComm) (pp. 1-6). Aalborg, DK.
MLA:
Ebell, Niklas, et al. "Reinforcement Learning Control Algorithm for a PV-Battery-System Providing Frequency Containment Reserve Power." Proceedings of the 2018 IEEE International Conference on Communications, Control, and Computing Technologies for Smart Grids (SmartGridComm), Aalborg 2018. 1-6.
BibTeX: Download