Resilient optimal defensive strategy of TSK fuzzy-model-based microgrids' system via a novel reinforcement learning approach

Abstract

With consideration of false data injection (FDI) on the demand side, it brings a great challenge for the optimal defensive strategy with the security issue, voltage stability, power flow, and economic cost indexes. This article proposes a Takagi-Sugeuo-Kang (TSK) fuzzy system-based reinforcement learning approach for the resilient optimal defensive strategy of interconnected microgrids. Due to FDI uncertainty of the system load, TSK-based deep deterministic policy gradient (DDPG) is proposed to learn the actor network and the critic network, where multiple indexes' assessment occurs in the critic network, and the security switching control strategy is made in the actor network. Alternating direction method of multipliers (ADMM) method is improved for policy gradient with online coordination between the actor network and the critic network learning, and its convergence and optimality are proved properly. On the basis of security switching control strategy, the penalty-based boundary intersection (PBI)-based multiobjective optimization method is utilized to solve economic cost and emission issues simultaneously with considering voltage stability and rate-of-change of frequency (RoCoF) limits. According to simulation results, it reveals that the proposed resilient optimal defensive strategy can be a viable and promising alternative for tackling uncertain attack problems on interconnected microgrids.