基于状态降维的快速强化学习电力网络系统控制

FAST REINFORCEMENT LEARNING POWER NETWORK SYSTEM CONTROL BASED ON STATE DIMENSION REDUCTION

  • 摘要: 为了避免大规模电力网络系统控制的维数灾,提升其可控性,提出一种基于状态降维的快速强化学习方法。通过投影矩阵投影测量状态来构造压缩状态向量,捕获开环网络模型的主要可控子空间,从而利用网络可控性的低秩属性避免了维数灾难;提出降维状态深度学习控制器,从而使结果成本接近最优LQR成本。通过一致性网络系统和IEEE广域控制实验结果,验证了提出的方法能够显著加快学习时间,同时保证了较好的优化性能。

     

    Abstract: In order to avoid dimension disaster and improve controllability, a fast reinforcement learning control method for large-scale power network system based on state dimension reduction is proposed. The compressed state vector was constructed by projecting the measured state through the projection matrix, and the main controllable subspace of the open-loop network model was captured, so the dimension disaster was avoided by using the low rank attribute of network controllability. A reduced dimension state depth learning controller was proposed to make the result cost close to the optimal LQR cost. The experimental results of consensus network system and IEEE wide area control show that the proposed method can significantly accelerate the learning time and ensure better sub-optimal performance.

     

/

返回文章
返回