• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
搜索

Author:

Duan, Lijuan (Duan, Lijuan.) (Scholars:段立娟) | Liu, Guangyuan (Liu, Guangyuan.) | En, Qing (En, Qing.) | Liu, Zhaoying (Liu, Zhaoying.) | Gong, Zhi (Gong, Zhi.) | Ma, Bian (Ma, Bian.)

Indexed by:

EI Scopus SCIE

Abstract:

Zero-shot object detection aims to identify objects from unseen categories not present during training. Existing methods rely on category labels to create pseudo-features for unseen categories, but they face limitations in exploring semantic information and lack robustness. To address these issues, we introduce a novel framework, EKZSD, enhancing zero-shot object detection by incorporating external knowledge and contrastive paradigms. This framework enriches semantic diversity, enhancing discriminative ability and robustness. Specifically, we introduce a novel external knowledge extraction module that leverages attribute and relationship prompts to enrich semantic information. Moreover, a novel external knowledge contrastive learning module is proposed to enhance the model's discriminative and robust capabilities by exploring pseudo- visual features. Additionally, we use cycle consistency learning to align generated visual features with original semantic features and adversarial learning to align visual features with semantic features. Collaboratively trained with contrast learning loss, cycle consistency loss, adversarial learning loss, and classification loss, our framework outperforms superior performance on the MSCOCO and Ship-43 datasets, as demonstrated in experimental results.

Keyword:

External knowledge Zero-shot object detection Supervised contrastive learning

Author Community:

  • [ 1 ] [Duan, Lijuan]Beijing Univ Technol, Beijing Key Lab Trusted Comp, Beijing 100124, Peoples R China
  • [ 2 ] [Liu, Guangyuan]Beijing Univ Technol, Beijing Key Lab Trusted Comp, Beijing 100124, Peoples R China
  • [ 3 ] [Gong, Zhi]Beijing Univ Technol, Beijing Key Lab Trusted Comp, Beijing 100124, Peoples R China
  • [ 4 ] [Ma, Bian]Beijing Univ Technol, Beijing Key Lab Trusted Comp, Beijing 100124, Peoples R China
  • [ 5 ] [Duan, Lijuan]Beijing Univ Technol, Natl Engn Lab Crit Technol Informat Secur Classifi, Beijing 100124, Peoples R China
  • [ 6 ] [Liu, Guangyuan]Beijing Univ Technol, Natl Engn Lab Crit Technol Informat Secur Classifi, Beijing 100124, Peoples R China
  • [ 7 ] [Gong, Zhi]Beijing Univ Technol, Natl Engn Lab Crit Technol Informat Secur Classifi, Beijing 100124, Peoples R China
  • [ 8 ] [Ma, Bian]Beijing Univ Technol, Natl Engn Lab Crit Technol Informat Secur Classifi, Beijing 100124, Peoples R China
  • [ 9 ] [Duan, Lijuan]Beijing Univ Technol, Fac Informat Technol, Beijing 100124, Peoples R China
  • [ 10 ] [Liu, Guangyuan]Beijing Univ Technol, Fac Informat Technol, Beijing 100124, Peoples R China
  • [ 11 ] [Liu, Zhaoying]Beijing Univ Technol, Fac Informat Technol, Beijing 100124, Peoples R China
  • [ 12 ] [Gong, Zhi]Beijing Univ Technol, Fac Informat Technol, Beijing 100124, Peoples R China
  • [ 13 ] [Ma, Bian]Beijing Univ Technol, Fac Informat Technol, Beijing 100124, Peoples R China
  • [ 14 ] [En, Qing]Carleton Univ, Sch Comp Sci, Ottawa, ON K1S 5B6, Canada

Reprint Author's Address:

  • [Liu, Zhaoying]Beijing Univ Technol, Fac Informat Technol, Beijing 100124, Peoples R China;;

Show more details

Related Keywords:

Source :

PATTERN RECOGNITION LETTERS

ISSN: 0167-8655

Year: 2024

Volume: 185

Page: 152-159

5 . 1 0 0

JCR@2022

Cited Count:

WoS CC Cited Count: 1

SCOPUS Cited Count: 1

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 0

Affiliated Colleges:

Online/Total:649/5311390
Address:BJUT Library(100 Pingleyuan,Chaoyang District,Beijing 100124, China Post Code:100124) Contact Us:010-67392185
Copyright:BJUT Library Technical Support:Beijing Aegean Software Co., Ltd.