面向多智能体合作的估计-控制-调度协同设计

Estimation-Control-Scheduling Co-Design for Multi-Agent Cooperation

  • 摘要: 为了提高多智能体完全合作任务中无线网络化控制系统(WNCS)在资源受限环境下的控制性能,本文提出一种基于深度强化学习(DRL)的估计-控制-调度协同设计方法,通过将状态估计、控制策略和资源调度紧密结合,以优化多智能体的决策控制与资源调度。本方法采用深度强化学习策略,通过循环神经网络来学习WNCS中观测量和状态量的时序依赖关系,有效增强了本方法在复杂工业环境中的适应性,同时降低了对精确系统动力学模型的依赖。在CoppeliaSim仿真平台上进行的多智能体协作搬运实验表明,相较于现有解耦设计方法,本方法将协作搬运任务完成率提升了3.8%,任务完成时间减少了7.6%。

     

    Abstract: To improve the control performance of wireless networked control system (WNCS) for fully cooperative multi-agent tasks in environments with limited radio resources, a Deep Reinforcement Learning (DRL)-based estimation-control-scheduling co-design method is proposed, which tightly integrates state estimation, control strategies, and resource scheduling to optimize multi-agent decision control and resource scheduling. The proposed method adopts a DRL strategy with recurrent neural networks to capture the temporal dependencies between observations and states in WNCS, thereby enhancing its adaptability in complex industrial environments while reducing reliance on accurate system dynamics models. Experimental results from multi-agent cooperative transportation tasks conducted on the CoppeliaSim simulation platform demonstrate that, compared to existing decoupled design methods, the proposed approach improves the cooperative transportation task success rate by 3.8% and reduces task completion time by 7.6%.

     

/

返回文章
返回