基于虚拟现实和眼动追踪的人-集群机器人交互方法

Human-Swarm Robots Interaction Approach Based on Virtual Reality and Eye Tracking

  • 摘要: 操作员对集群机器人实施远程控制时面临被控对象众多、群体态势感知困难、集体行为控制不易等诸多挑战, 使得手动遥控等传统交互方式无法实现高效、灵活、强沉浸感的人-集群机器人交互。为此, 提出一种基于虚拟现实(VR)和眼动追踪的人-集群机器人交互(HSI)方法。首先, 构建集群机器人VR交互场景并采集操作员的眼动数据; 其次, 解析获得瞳孔坐标、注视点等眼动特征, 据此生成集群机器人的运动控制指令; 最后, 开展了真实集群机器人集群漫游、集群目标追踪及集群轨迹跟踪交互实验。机器人实验结果表明, 该方法可实现灵活、便捷的人-集群机器人远程交互控制, 这为人与集群机器人的共融协作提供了一种新的途径。

     

    Abstract: Remote control of swarm robots by human operators is fraught with many issues due to the vast number of controlled robots, the difficulty of accessing the state of swarms, and the difficulty of regulating the collective actions of robots.As a result, some conventional interaction methods, such as manual remote control, cannot achieve efficient, flexible, and highly immersive human-swarm robot interactions.We propose a novel human-swarm robot interaction (HSI) approach based on virtual reality (VR) and eye-tracking techniques.First, we construct a VR interaction scene of swarm robots and collect the eye-tracking data of operators.Second, we analytically obtain eye movement features such as pupil and gaze positions and generate the motion control instructions of the swarm robots accordingly.Finally, we test the proposed HSI approach through three experiments using real swarm robots: swarm roaming, swarm goal-oriented tracking, and swarm trajectory tracking.The robot experimental results show that our HSI approach can realize flexible and convenient human-swarm robot remote interactive control, which provides a new form for human-swarm robot interactions.

     

/

返回文章
返回