• 综合
  • 标题
  • 关键词
  • 摘要
  • 学者
  • 期刊-刊名
  • 期刊-ISSN
  • 会议名称
搜索

作者:

Shi, Ge (Shi, Ge.) | Deng, Sinuo (Deng, Sinuo.) | Wang, Bo (Wang, Bo.) | Feng, Chong (Feng, Chong.) | Zhuang, Yan (Zhuang, Yan.) | Wang, Xiaomei (Wang, Xiaomei.)

收录:

EI Scopus SCIE

摘要:

Image Emotion Classification (IEC) is an essential research area, offering valuable insights into user emotional states for a wide range of applications, including opinion mining, recommendation systems, and mental health treatment. The challenges associated with IEC are mainly attributed to the complexity and ambiguity of human emotions, the lack of a universally accepted emotion model, and excessive dependence on prior knowledge. To address these challenges, we propose a novel Unified Generative framework for Image Emotion Classification (UGRIE), which is capable of simultaneously modeling various emotion models and capturing intricate semantic relationships between emotion labels. Our approach employs a flexible natural language template, converting the IEC task into a template-filling process that can be easily adapted to accommodate a diverse range of IEC tasks. To further enhance the performance, we devise a mapping mechanism to seamlessly integrate the multimodal pre-training model CLIP with the text generation pre-training model BART, thus leveraging the strengths of both models. A comprehensive set of experiments conducted on multiple public datasets demonstrates that our proposed method consistently outperforms existing approaches to a large margin in supervised settings, exhibits remarkable performance in low-resource scenarios, and unifies distinct emotion models within a single, versatile framework.

关键词:

Task analysis Adaptation models Emotion recognition images emotion classification multi-modal learning Semantics Data models Psychology IEC Pre-training model

作者机构:

  • [ 1 ] [Shi, Ge]Beijing Univ Technol, Fac Informat Technol, Beijing 100124, Peoples R China
  • [ 2 ] [Deng, Sinuo]Beijing Univ Technol, Fac Informat Technol, Beijing 100124, Peoples R China
  • [ 3 ] [Shi, Ge]Beijing Zhongke Huili Technol Co Ltd, Beijing 100085, Peoples R China
  • [ 4 ] [Wang, Bo]Beijing Inst Technol, Sch Comp Sci, Beijing 100081, Peoples R China
  • [ 5 ] [Feng, Chong]Beijing Inst Technol, Sch Comp Sci, Beijing 100081, Peoples R China
  • [ 6 ] [Zhuang, Yan]Chinese Peoples Liberat Army Gen Hosp, Beijing 100039, Peoples R China
  • [ 7 ] [Wang, Xiaomei]Chinese Acad Sci, Inst Sci & Dev, Beijing 100190, Peoples R China

通讯作者信息:

  • [Feng, Chong]Beijing Inst Technol, Sch Comp Sci, Beijing 100081, Peoples R China;;

查看成果更多字段

相关关键词:

来源 :

IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY

ISSN: 1051-8215

年份: 2024

期: 8

卷: 34

页码: 7057-7068

8 . 4 0 0

JCR@2022

被引次数:

WoS核心集被引频次:

SCOPUS被引频次: 10

ESI高被引论文在榜: 0 展开所有

万方被引频次:

中文被引频次:

近30日浏览量: 1

归属院系:

在线人数/总访问数:374/4897197
地址:北京工业大学图书馆(北京市朝阳区平乐园100号 邮编:100124) 联系我们:010-67392185
版权所有:北京工业大学图书馆 站点建设与维护:北京爱琴海乐之技术有限公司