• 综合
  • 标题
  • 关键词
  • 摘要
  • 学者
  • 期刊-刊名
  • 期刊-ISSN
  • 会议名称
搜索

作者:

Lu, Jiaxuan (Lu, Jiaxuan.) | Wan, Hai (Wan, Hai.) | Li, Peiyan (Li, Peiyan.) | Zhao, Xibin (Zhao, Xibin.) | Ma, Nan (Ma, Nan.) | Gao, Yue (Gao, Yue.)

收录:

EI Scopus SCIE

摘要:

Person re- identification (Re-ID) has become a hot research topic due to its widespread applications. Conducting person Re-ID in video sequences is a practical requirement, in which the crucial challenge is how to pursue a robust video representation based on spatial and temporal features. However, most of the previous methods only consider how to integrate part-level features in the spatio-temporal range, while how to model and generate the part-correlations is little exploited. In this paper, we propose a skeleton-based dynamic hypergraph framework, namely Skeletal Temporal Dynamic Hypergraph Neural Network (ST-DHGNN) for person Re-ID, which resorts to modeling the high-order correlations among various body parts based on a time series of skeletal information. Specifically, multi-shape and multi-scale patches are heuristically cropped from feature maps, constituting spatial representations in different frames. A joint-centered hypergraph and a bone-centered hypergraph are constructed in parallel from multiple body parts (i.e., head, trunk, and legs) with spatio-temporal multi-granularity in the entire video sequence, in which the graph vertices representing regional features and hyperedges denoting relationships. Dynamic hypergraph propagation containing the re- planning module and the hyperedge elimination module is proposed to better integrate features among vertices. Feature aggregation and attention mechanisms are also adopted to obtain a better video representation for person Re-ID. Experiments show that the proposed method performs significantly better than the state-of-the-art on three video-based person Re-ID datasets, including iLIDS-VID, PRID-2011, and MARS.

关键词:

hypergraph Task analysis Person re-identification Video sequences Feature extraction Legged locomotion Correlation spatio-temporal correlation Head Joints hypergraph learning

作者机构:

  • [ 1 ] [Lu, Jiaxuan]Tsinghua Univ, Sch Software, BNRist, THUIBCS,KLISS,BLBCI, Beijing 100084, Peoples R China
  • [ 2 ] [Wan, Hai]Tsinghua Univ, Sch Software, BNRist, THUIBCS,KLISS,BLBCI, Beijing 100084, Peoples R China
  • [ 3 ] [Zhao, Xibin]Tsinghua Univ, Sch Software, BNRist, THUIBCS,KLISS,BLBCI, Beijing 100084, Peoples R China
  • [ 4 ] [Gao, Yue]Tsinghua Univ, Sch Software, BNRist, THUIBCS,KLISS,BLBCI, Beijing 100084, Peoples R China
  • [ 5 ] [Li, Peiyan]Columbia Univ, Dept Stat, New York, NY 10027 USA
  • [ 6 ] [Ma, Nan]Beijing Univ Technol, Beijing Inst Artificial Intelligence, Beijing 100124, Peoples R China

通讯作者信息:

  • [Gao, Yue]Tsinghua Univ, Sch Software, BNRist, THUIBCS,KLISS,BLBCI, Beijing 100084, Peoples R China;;[Ma, Nan]Beijing Univ Technol, Beijing Inst Artificial Intelligence, Beijing 100124, Peoples R China;;

查看成果更多字段

相关关键词:

来源 :

IEEE TRANSACTIONS ON IMAGE PROCESSING

ISSN: 1057-7149

年份: 2023

卷: 32

页码: 949-963

1 0 . 6 0 0

JCR@2022

ESI学科: ENGINEERING;

ESI高被引阀值:19

被引次数:

WoS核心集被引频次: 10

SCOPUS被引频次: 15

ESI高被引论文在榜: 0 展开所有

万方被引频次:

中文被引频次:

近30日浏览量: 6

归属院系:

在线人数/总访问数:87/4300975
地址:北京工业大学图书馆(北京市朝阳区平乐园100号 邮编:100124) 联系我们:010-67392185
版权所有:北京工业大学图书馆 站点建设与维护:北京爱琴海乐之技术有限公司