基于注意力机制的多特征融合人脸活体检测

Face Liveness Detection Based on Multi-feature Fusion with an Attention Mechanism

  • 摘要: 针对常规人脸活体检测中存在的特征信息提取不足、准确率不高、容易被欺骗等问题,提出了一种基于注意力机制的多特征融合人脸活体检测算法.首先,为充分利用图像的低层特征,将原始人脸图像通过变换得到傅里叶频谱图,结合局部二值模式图和简化的韦伯局部描述图作为检测模型的输入.其次,再把这3种类型的图像分别输入到3个结构相同的ResNet支流中.然后,引入注意力机制来表征不同特征对于识别的重要性,将提取到的特征进行加权融合.最后,在基准数据库CASIA-FASD和Replay-Attack上进行实验,并与现有方法进行对比.实验结果表明,引入注意力机制的多特征融合方法可以提高人脸活体检测的准确性,且可同时增强算法的鲁棒性和泛化能力.

     

    Abstract: Aiming to solve insufficient feature information extraction, low accuracy, and ease of deception in conventional face liveness detection, an face liveness detection based on multi-feature fusion with an attention mechanism is proposed. First, to make full use of the low-level features of the image, the original face image is transformed to obtain the Fourier Spectrum. The local binary pattern and simplified Weber local description images are used as the input of the detection model. Next, these three types of images are imported into three branches of ResNet with the same structure. Then, the attention mechanism is introduced to represent the importance of different features for recognition, and the extracted features are weighted and fused. Finally, experiments are carried out on the CASIA-FASD and Replay-Attack benchmark datasets and compared to other existing methods. The experimental results showed that the multi-feature fusion method with an attention mechanism improvs face detection accuracy and simultaneously enhancs the algorithm's robustness and generalizability.

     

/

返回文章
返回