• 综合
  • 标题
  • 关键词
  • 摘要
  • 学者
  • 期刊-刊名
  • 期刊-ISSN
  • 会议名称
搜索

作者:

Zhang, Xiaodan (Zhang, Xiaodan.) | Dou, Shixin (Dou, Shixin.) | Ji, Junzhong (Ji, Junzhong.) (学者:冀俊忠) | Liu, Ying (Liu, Ying.) | Wang, Zheng (Wang, Zheng.)

收录:

EI Scopus SCIE

摘要:

Automatic generation of medical reports for Brain Computed Tomography (CT) imaging is crucial for helping radiologists make more accurate clinical diagnoses efficiently. Brain CT imaging typically contains rich pathological information, including common pathologies that often co-occur in one report and rare pathologies that appear in medical reports with lower frequency. However, current research ignores the potential co-occurrence between common pathologies and pays insufficient attention to rare pathologies, severely restricting the accuracy and diversity of the generated medical reports. In this paper, we propose a Co-occurrence Relationship Driven Hierarchical Attention Network (CRHAN) to improve Brain CT report generation by mining common and rare pathologies in Brain CT imaging. Specifically, the proposed CRHAN follows a general encoder-decoder framework with two novel attention modules. In the encoder, a co-occurrence relationship guided semantic attention (CRSA) module is proposed to extract the critical semantic features by embedding the co-occurrence relationship of common pathologies into semantic attention. In the decoder, a common-rare topic driven visual attention (CRVA) module is proposed to fuse the common and rare semantic features as sentence topic vectors, and then guide the visual attention to capture important lesion features for medical report generation. Experiments on the Brain CT dataset demonstrate the effectiveness of the proposed method.

关键词:

Brain CT medical report generation Computed tomography Pathology Medical diagnostic imaging Visualization hierarchical attention mechanism Semantics Feature extraction Biomedical imaging Co-occurrence relationship

作者机构:

  • [ 1 ] [Zhang, Xiaodan]Beijing Univ Technol, Coll Comp Sci, Beijing 100021, Peoples R China
  • [ 2 ] [Dou, Shixin]Beijing Univ Technol, Coll Comp Sci, Beijing 100021, Peoples R China
  • [ 3 ] [Ji, Junzhong]Beijing Univ Technol, Coll Comp Sci, Beijing 100021, Peoples R China
  • [ 4 ] [Liu, Ying]Peking Univ Third Hosp, Dept Radiol, Beijing 100191, Peoples R China
  • [ 5 ] [Wang, Zheng]Peking Univ Third Hosp, Dept Radiol, Beijing 100191, Peoples R China

通讯作者信息:

  • [Ji, Junzhong]Beijing Univ Technol, Coll Comp Sci, Beijing 100021, Peoples R China;;[Liu, Ying]Peking Univ Third Hosp, Dept Radiol, Beijing 100191, Peoples R China;;

查看成果更多字段

相关关键词:

来源 :

IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE

ISSN: 2471-285X

年份: 2024

被引次数:

WoS核心集被引频次:

SCOPUS被引频次:

ESI高被引论文在榜: 0 展开所有

万方被引频次:

中文被引频次:

近30日浏览量: 0

归属院系:

在线人数/总访问数:533/4948352
地址:北京工业大学图书馆(北京市朝阳区平乐园100号 邮编:100124) 联系我们:010-67392185
版权所有:北京工业大学图书馆 站点建设与维护:北京爱琴海乐之技术有限公司