基于DDQN辅助NSGA-III的含氢综合能源系统运行优化

Operation Optimization of Hydrogen-based Integrated Energy Systems Based on DDQN-assisted NSGA-III

  • 摘要: 针对电-氢-热综合能源系统运行优化中多目标协同难、进化算法效率低及探索能力不足的问题,本文提出一种基于双深度Q网络(DDQN)辅助第3代非支配排序遗传算法(NSGA-III)的双目标运行优化方法。该方法将遗传算子的自适应选择建模为马尔可夫决策过程,利用DDQN框架训练智能体,使其能够根据种群进化状态自适应选择最优算子,并结合NSGA-III的参考点选择机制从而获得更优的帕累托前沿。仿真结果表明,所提方法在收敛性和解集质量上均优于对比方案,在相同碳排放水平下,能够降低系统运行成本1.1%-6.3%。通过提升算法的进化效率与全局探索能力,该方法获得了更优的帕累托前沿策略,实现了能源系统经济性与低碳性的有效权衡。

     

    Abstract: To address the problems of difficult multi-objective coordination, low efficiency of evolutionary algorithms, and insufficient exploration capability in the operation optimization of electricity-hydrogen-thermal integrated energy systems, a bi-objective operation optimization method based on the Double Deep Q-Network (DDQN) assisted Third-Generation Non-dominated Sorting Genetic Algorithm (NSGA-III) is proposed. The adaptive selection of genetic operators is modeled as a Markov decision process, and an agent is trained within the DDQN framework to adaptively select the optimal operator according to the population evolution state, which is then combined with the reference point selection mechanism of NSGA-III to obtain a superior Pareto front. Simulation results indicate that the proposed method is superior to comparison schemes in terms of convergence and solution set quality, and the system operating costs are reduced by 1.1%–6.3% at the same carbon emission level. By enhancing the evolutionary efficiency and global exploration capability of the algorithm, a superior Pareto front strategy is obtained, and an effective trade-off between the economic efficiency and low-carbon property of the energy system is achieved.

     

/

返回文章
返回