DG-3D:基于深度引导的3维目标检测方法

DG-3D: Depth-guided 3D Object Detection Method

  • 摘要: 针对自动驾驶纯视觉3维(3D)目标检测中2维(2D)图像特征缺乏显式深度约束、3D查询初始化缺乏目标位置先验的问题,提出基于深度引导的3D目标检测方法——DG-3D,即将深度信息引入特征编码和查询初始化过程。首先,设计全局相机感知深度预测模块,结合相机内参显式回归像素级深度图。其次,引入几何编码模块,通过构建平面几何先验和深度距离先验,利用深度感知几何注意力机制增强视觉特征的空间感知能力。最后,设计目标中心查询生成模块,利用深度引导的2D检测结果及预测深度,通过反投影生成目标中心3D查询,为查询初始化提供目标位置先验。在nuScenes大规模自动驾驶数据集上的实验结果表明,DG-3D在所有配置下均优于现有先进方法。在采用残差网络ResNet101+骨干网络时,DG-3D取得52.8%的平均精度(mAP)和61.0%的nuScenes检测得分(NDS)。

     

    Abstract: To address the lack of explicit depth constraints in 2D image features and object location priors for 3D query initialization in vision-based 3D object detection for autonomous driving, we propose DG-3D, a depth-guided 3D object detection method that introduces depth information into feature encoding and query initialization. First, a global camera-aware depth prediction module uses camera intrinsics to explicitly regress a pixel-wise depth map. Second, a geometric encoding module constructs planar geometric and depth-distance priors, and uses depth-aware geometric attention to enhance the spatial awareness of visual features. Finally, an object-center query generation module combines depth-guided 2D detection results with predicted depths and generates object-center 3D queries through back-projection, providing object location priors for query initialization. Experiments on the large-scale nuScenes autonomous driving dataset show that DG-3D outperforms existing state-of-the-art methods across all configurations. With ResNet101+ as the backbone, DG-3D achieves 52.8% mean average precision (mAP) and a 61.0% nuScenes detection score (NDS).

     

/

返回文章
返回