• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
搜索

Author:

Yin, Zihao (Yin, Zihao.) | Du, Yongping (Du, Yongping.) | Liu, Yang (Liu, Yang.) | Wang, Yuxin (Wang, Yuxin.)

Indexed by:

EI Scopus

Abstract:

Sentiment analysis aims to detect the sentiment polarity towards the massive opinions and reviews emerging on the internet. With the increasing of multimodal information on social media, such as text, image, audio and video, multimodal sentiment analysis has attracted more attention in recent years and our work focuses on the text and image data. The previous works usually ignore the semantic alignment between the text and image, and cannot capture the interaction between them, which will affect the correct judgement for the sentiment polarity prediction. To resolve these problems, we propose a novel multimodal sentiment analysis model LXMERT-MMSA based on cross-modality attention mechanism. The single-modality feature is encoded by multi-layer Transformer encoder to achieve the deep semantic information implied in the text and image. Moreover, the cross-modality attention mechanism enables the model to fuse the text and image features effectively and achieve the rich semantic information by the alignment. It improves the ability of the model to capture the semantic relation between text and image. The evaluation metrics of accuracy and F1 score are used, and the experimental results on MVSA-multiple dataset and Twitter dataset show that our proposed model outperforms the previous SOTA model, and the ablation experimental results further prove that the model can make well use of multimodal features. © The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature 2024.

Keyword:

Petroleum reservoir evaluation Semantics Image enhancement Modal analysis Social networking (online) Sentiment analysis

Author Community:

  • [ 1 ] [Yin, Zihao]Faculty of Information Technology, Beijing University of Technology, Pingleyuan 100, Beijing; 100124, China
  • [ 2 ] [Du, Yongping]Faculty of Information Technology, Beijing University of Technology, Pingleyuan 100, Beijing; 100124, China
  • [ 3 ] [Liu, Yang]Faculty of Information Technology, Beijing University of Technology, Pingleyuan 100, Beijing; 100124, China
  • [ 4 ] [Wang, Yuxin]Faculty of Information Technology, Beijing University of Technology, Pingleyuan 100, Beijing; 100124, China

Reprint Author's Address:

Email:

Show more details

Related Keywords:

Related Article:

Source :

Multimedia Tools and Applications

ISSN: 1380-7501

Year: 2024

Issue: 21

Volume: 83

Page: 60171-60187

3 . 6 0 0

JCR@2022

Cited Count:

WoS CC Cited Count:

SCOPUS Cited Count: 6

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 2

Affiliated Colleges:

Online/Total:551/5294056
Address:BJUT Library(100 Pingleyuan,Chaoyang District,Beijing 100124, China Post Code:100124) Contact Us:010-67392185
Copyright:BJUT Library Technical Support:Beijing Aegean Software Co., Ltd.