基于深度强化学习的无人机目标跟踪和障碍规避融合控制方法

Fusion Control for UAV Target Tracking and Obstacle Avoidance Based on Deep Reinforcement Learning

  • 摘要: 在障碍环境下,由于目标运动不确定、视野遮挡、无人机自身动力学约束等影响,无人机对非协作目标的持续跟踪依然面临着技术挑战。对此,提出了一种基于深度强化学习的目标跟踪和障碍规避融合控制方法。该方法基于端到端的思想,设计直接从图像特征映射到无人机控制指令的融合控制策略,可有效克服传统控制中跟踪与避障模块分离设计的局限。首先,设计一种结合单应性变换的运动补偿扩展卡尔曼滤波方法,在图像平面中实时估计目标的位置与运动方向;随后,设计基于深度强化学习的运动控制器,将传感器观测输入策略网络,实时生成控制指令,使无人机能够自主跟踪运动目标并规避障碍。通过对比实验,验证了所提方法在目标跟踪稳定性、运动平滑度及计算实时性等方面的优越性。

     

    Abstract: In obstacle environments, persistent tracking of non-cooperative target remains technically challenging for UAV due to factors such as uncertain target motion, visual occlusion, and inherent UAV dynamic constraints. To address this, we propose a fusion control method for target tracking and obstacle avoidance based on deep reinforcement learning. Adopting an end-to-end approach, this method designs a fusion control strategy that directly maps image features to UAV control commands, effectively overcoming the limitations of traditional control methods where tracking and obstacle avoidance modules are designed separately. Firstly, we design a motion-compensated extended Kalman filter incorporating homogeneous transformations to estimate target position and motion direction in real-time within the image plane. Subsequently, we develop a motion controller based on deep reinforcement learning. Sensor observations are fed into the policy network to generate control commands in real-time, enabling the UAV to autonomously track the moving target while avoiding obstacles. Comparative experiments verify the superior performance of the proposed method in terms of target tracking stability, motion smoothness, and computational real-time capability.

     

/

返回文章
返回