Zhang, TingjunYu, LiangYue, DongDou, ChunxiaXie, XiangpengHancke, Gerhard P.2023-11-302023-11-302024-03Zhang, T.J., Yu, L., Yue, D. et al. 'Two-timescale coordinated voltage regulation for high renewable-penetrated active distribution networks considering hybrid devices', IEEE Transactions on Industrial Informatics, vol. 20, no. 3, pp. 3456-3467, March 2024, doi: 10.1109/TII.2023.3308348.1551-3203 (print)1941-0050 (online)10.1109/TII.2023.3308348http://hdl.handle.net/2263/93553The integration of large-scale distributed generators into active distribution networks (ADNs) will aggravate voltage fluctuations, which can affect the secure operation of power grids seriously. In this article, we investigate a cooperated voltage regulation problem of ADNs. Specifically, we first formulate a two-timescale voltage regulation problem considering the coordination of various hybrid devices while reducing the power loss of the whole ADNs. Given that the aforementioned problem is challenging to solve directly, we reformulate it as bilevel Markov games. Then, we propose a hierarchical multi-agent attention-based deep reinforcement learning algorithm to solve them. To be specific, the upper level Markov game is solved by a discrete multi-actor-attention-critic (MAAC) algorithm, and the lower level Markov game is solved by a continuous MAAC algorithm. In addition, the two-timescale coordination between upper level and lower level agents is implemented through the information exchange of rewards during the training process. Simulation results show that the proposed algorithm has good effectiveness, robustness, and scalability in voltage regulation.en© 2023 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission.Active distribution network (ADN)Multi-actor-attention-critic (MAAC)Two-timescale voltage regulationHybrid devicesHierarchical multi-agent attention-based deep reinforcement learning (HMAADRL)Bilevel Markov gamesReactive powerStatic VAR compensatorsRegulationGamesMarkov processesOptimizationVoltage controlSDG-09: Industry, innovation and infrastructurePostprint Article