• 综合
  • 标题
  • 关键词
  • 摘要
  • 学者
  • 期刊-刊名
  • 期刊-ISSN
  • 会议名称
搜索

作者:

Cui, Zheng (Cui, Zheng.) | Hu, Yongli (Hu, Yongli.) | Wang, Jiapu (Wang, Jiapu.) | Gao, Junbin (Gao, Junbin.) | Sun, Yanfeng (Sun, Yanfeng.) | Yin, Baocai (Yin, Baocai.)

收录:

EI Scopus

摘要:

The task of image-text retrieval has gained significant attention in the realm of multimodal artificial intelligence. Nonetheless, existing works encounter challenges in efficiently utilizing inter-modal information and adequately leveraging crucial intra-modal details. In this paper, we propose a novel common-Memory Bridged cross-modal Adaptive Graph Embedding (MBAGE) network for image-text retrieval. Initially, we represent images and text as graphs, wherein nodes symbolize salient regions and words. Subsequently, we incorporate a common-memory bank as an intermediate bridge, facilitating interactions between nodes in the two graphs and enabling efficient utilization of inter-modal information. Additionally, we propose an adaptive graph convolutional network to implement intra-modal interaction, which can adaptively suppress the learning of unimportant nodes. Finally, adaptive pooling is employed to retain essential information, yielding a superior holistic embedding. Experimental results on the Flickr30K and MS-COCO datasets demonstrate that the MBAGE network not only achieves compelling retrieval precision but also exhibits high retrieval efficiency. © 2024 IEEE.

关键词:

Network embeddings Image retrieval Text mining Graph embeddings Optical character recognition Image coding Network theory (graphs)

作者机构:

  • [ 1 ] [Cui, Zheng]Beijing University of Technology, Beijing Institute of Artificial Intelligence, Beijing, China
  • [ 2 ] [Hu, Yongli]Beijing University of Technology, Beijing Institute of Artificial Intelligence, Beijing, China
  • [ 3 ] [Wang, Jiapu]Beijing University of Technology, Beijing Institute of Artificial Intelligence, Beijing, China
  • [ 4 ] [Gao, Junbin]The University of Sydney Business School, The University of Sydney, Sydney, Australia
  • [ 5 ] [Sun, Yanfeng]Beijing University of Technology, Beijing Institute of Artificial Intelligence, Beijing, China
  • [ 6 ] [Yin, Baocai]Beijing University of Technology, Beijing Institute of Artificial Intelligence, Beijing, China

通讯作者信息:

电子邮件地址:

查看成果更多字段

相关关键词:

相关文章:

来源 :

ISSN: 1945-7871

年份: 2024

语种: 英文

被引次数:

WoS核心集被引频次:

SCOPUS被引频次:

ESI高被引论文在榜: 0 展开所有

万方被引频次:

中文被引频次:

近30日浏览量: 0

归属院系:

在线人数/总访问数:278/4974826
地址:北京工业大学图书馆(北京市朝阳区平乐园100号 邮编:100124) 联系我们:010-67392185
版权所有:北京工业大学图书馆 站点建设与维护:北京爱琴海乐之技术有限公司