Logo image
Distributed Q-Learning-Based Voltage Restoration Algorithm in Isolated AC Microgrids Subject to Input Saturation
期刊文章   同儕審查

Distributed Q-Learning-Based Voltage Restoration Algorithm in Isolated AC Microgrids Subject to Input Saturation

Shih-Wen LinChia-Chi Chu
IEEE Transactions on Industry Applications
2024

摘要

consensus algorithm Decentralized control distributed control Heuristic algorithms Internet of Things Mathematical models Microgrid modified algebraic Riccati equation multi-agent reinforcement learning plug-and-play Q-learning Q-learning Riccati equations saturation limit Voltage control voltage restoration Control and Systems Engineering Industrial and Manufacturing Engineering Electrical and Electronic Engineering
A model-free data-driven Q-learning-based distributed control is proposed for achieving autonomous voltage restoration in isolated AC microgrids (MGs) subject to input saturation. First, by defining the control objective in terms of local neighborhood tracking errors, the voltage restoration problem can be solved by the distributed pinning-based consensus problem. To address the effect of input signal saturation in each distributed generator (DG), the low gain feedback method is considered to obtain these feedback gains. Since these feedback gain matrices are obtained by solving the modified algebraic Riccati equation&null) which needs the complete knowledge of DG dynamics, an iterative model-free data-driven Q-learning algorithm is presented. A Q-learning function and a Q-learning Bellman equation&null defined for finding these feedback gain matrices. Finally, based on recursive least square techniques, an iterative Q-learning algorithm is proposed for achieving autonomous voltage restoration. To validate the performance of the proposed method, simulations of two isolated AC MG are performed. Simulation results demonstrate that the acquired feedback gains closely align with these analytical solutions of the MARE. Furthermore, the proposed model-free distributed Q-learning method remains its effectiveness even under model uncertainty and plug-and-play operations of DGs.

相關連結

指標

1 檢視次數

詳細資料

Logo image