不确定环境下能源系统学习增强联邦协同调度

Learning-Enhanced Federated Collaborative Scheduling of Energy Systems under Uncertainty

  • 摘要: 针对区域综合能源系统多主体协同调度中存在的数据隐私保护需求、分布式协调计算开销较大以及电价波动带来的运行不确定性问题,提出一种学习增强的联邦分布式协同调度方法。首先构建区域综合能源系统联邦分布式协调优化模型,通过联邦协调变量实现跨子系统耦合约束的统一表达,使各能源子系统能够在本地完成优化计算并保持运行数据不出域。其次将联邦协调变量的更新过程建模为马尔可夫决策过程,引入强化学习对协调更新策略进行学习增强,通过学习协调变量的更新方向与幅度减少协调迭代次数,从而提高分布式求解效率。进一步结合滚动优化框架,并利用模糊C均值方法对电价进行在线修正,提高调度策略对电价不确定性的适应能力。算例结果表明,在典型运行场景下所提方法能够实现多能源系统的协同调度,其运行成本较软演员–评论家算法(SAC)和深度确定性策略梯度算法(DDPG)方法分别降低约0.42%和0.49%,与集中式优化结果的差距小于0.5%,同时,通过强化学习对协调更新策略进行学习增强后,计算时间降低约71.6%。在不同电价扰动条件下,系统运行成本始终保持在理想成本附近区间,表现出良好的稳定性与鲁棒性。结果表明,该方法能够在保证数据本地存储的前提下提高联邦分布式协调效率,并增强综合能源系统在不确定运行环境下的调度适应能力。

     

    Abstract: To address the issues of data privacy protection requirements, high computational overhead in distributed coordination, and operational uncertainty caused by electricity price fluctuations in multi-agent coordinated scheduling of regional integrated energy systems, a learning-enhanced federated distributed coordinated dispatch method is proposed. First, a federated distributed coordination optimization model for regional integrated energy systems is established, and federated coordination variables are introduced to represent the coupling constraints among subsystems, enabling each energy subsystem to perform local optimization while keeping operational data within the local domain. Then, the update process of the federated coordination variables is modeled as a Markov decision process, and reinforcement learning is introduced to enhance the coordination update strategy, by learning the update direction and magnitude of the coordination variables, the number of coordination iterations is reduced, thereby improving the efficiency of distributed solution. Furthermore, a rolling optimization framework is incorporated, and the fuzzy C-means method is used to perform online correction of electricity price to improve the adaptability of the dispatch strategy under electricity price uncertainty. Case studies show that the proposed method can achieve coordinated dispatch of multiple energy systems under typical operating scenarios. Compared with soft Actor-Critic (SAC) and deep deterministic policy gradient (DDPG) methods, the operating cost is reduced by approximately 0.42% and 0.49%, respectively, and the gap with the centralized optimization result is less than 0.5%. Meanwhile, reinforcement learning enhancement of the coordination update strategy reduces the computation time by approximately 71.6%. Under different electricity price disturbance scenarios, the system operating cost remains close to the ideal cost level, demonstrating good stability and robustness. The results indicate that the proposed method improves the efficiency of federated distributed coordination while ensuring local data storage and enhances the adaptability of integrated energy system scheduling under uncertain operating conditions.

     

/

返回文章
返回