基于双注意力机制的可见光-红外行人重识别
DOI:
作者:
作者单位:

1.华东交通大学理学院;2.华东交通大学江西省先进控制与优化重点实验室

作者简介:

通讯作者:

中图分类号:

基金项目:

国家自然科学基金项目;教育部人为社会科学研究项目;江西省自然科学基金项目


Base on Dual Attention Mechanism for Visible-Infrared Person Re-Identification
Author:
Affiliation:

Fund Project:

The National Natural Science Foundation of China;The Ministry of education of Humanities and Social Science Project;Natural Science Foundation of Jiangxi Province

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    近些年可见光-红外行人重识别受到众多学者的关注,其目标是从不同模态的图像中匹配出相同身份的行人图像,但由于可见光图像和红外图像之间的巨大差异,导致可见光-红外行人重识别是一项非常具有挑战性的图像检索问题。现有的研究主要集中在通过设计网络结构提取共享特征或生成中间模态来缓解模态差异,容易受到行人之外的区域影响。为了解决此类问题,重点关注行人信息,进一步减小两种模态之间的差异,提出一种双注意力机制的网络结构用于可见光-红外行人重识别,一方面通过双注意力机制挖掘不同尺度的行人空间信息和增强局部特征的通道交互能力,另一方面利用全局分支和局部分支,学习多粒度的特征信息,使不同粒度信息可以相互补充,形成一个更具辨别性的特征。在两个公共数据集上的实验结果表明,该方法相较于基线有明显的提升,在RegDB数据集和SYSU-MM01数据集上均表现出理想的性能。

    Abstract:

    In recent years, visible-infrared person re-identification has attracted the attention of many scholars, and its goal is to match person images with the same identity from images of different modalities. Due to the huge difference between visible images and infrared images, visible-infrared person re-identification is a very challenging image retrieval problem. Existing research focuses on mitigating modal differences by designing network structures to extract shared features or generate intermediate modalities, which are susceptible to areas other than person. In order to solve such problems, focus on person information, and further reduce the difference between the two modes, a network structure of dual attention mechanism is proposed for visible-infrared person re-identification, on the one hand, through the dual attention mechanism to mine person spatial information of different scales and enhance the channel interaction ability of local features. On the other hand, the use of global branches and local branches, learn multi-granular feature information, so that different granular information can complement each other to form a more discriminating feature. Experimental results on two public datasets show that the proposed method has a significant improvement compared with the baseline, and shows ideal performance on both the RegDB dataset and the SYSU-MM01 dataset.

    参考文献
    相似文献
    引证文献
引用本文
分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2023-05-10
  • 最后修改日期:2023-06-21
  • 录用日期:2023-06-27
  • 在线发布日期: 2024-03-25
  • 出版日期: