• 综合
  • 标题
  • 关键词
  • 摘要
  • 学者
  • 期刊-刊名
  • 期刊-ISSN
  • 会议名称
搜索

作者:

Duan, Lijuan (Duan, Lijuan.) (学者:段立娟) | Ge, Hui (Ge, Hui.) | Yang, Zhen (Yang, Zhen.) (学者:杨震) | Chen, Juncheng (Chen, Juncheng.)

收录:

CPCI-S

摘要:

This paper presents a multimodal fusion approach using kernel-based Extreme Learning Machine (ELM) for video emotion recognition by combing video content and electroencephalogram (EEG) signals. Firstly, several audio-based features and visual-based features are extracted from video clips and EEG features are obtained by using Wavelet Packet Decomposition (WPD). Secondly, video features are selected using Double Input Symmetrical Relevance (DISR) and EEG features are selected by Decision Tree (DT). Thirdly, multimodal fusion using kernel-based ELM is adopted for classification by combing video and EEG features at decision-level. In order to test the validity of the proposed method, we design and conduct the EEG experiment to collect data that consisted of video clips and EEG signals of subjects. We compare our method separately with single mode methods of using video content only and EEG signals only on classification accuracy. The experimental results show that the proposed fusion method produces better classification performance than those of the video emotion recognition methods which use either video content or EEG signals alone.

关键词:

EEG Kernel-based ELM Multimodal fusion Video emotion recognition

作者机构:

  • [ 1 ] [Duan, Lijuan]Beijing Univ Technol, Coll Comp Sci & Technol, Beijing Key Lab Trusted Comp, Beijing 100124, Peoples R China
  • [ 2 ] [Ge, Hui]Beijing Univ Technol, Coll Comp Sci & Technol, Beijing Key Lab Trusted Comp, Beijing 100124, Peoples R China
  • [ 3 ] [Yang, Zhen]Beijing Univ Technol, Coll Comp Sci & Technol, Beijing Key Lab Trusted Comp, Beijing 100124, Peoples R China
  • [ 4 ] [Duan, Lijuan]Beijing Univ Technol, Coll Comp Sci & Technol, Beijing Key Lab Integrat & Anal Large Scale Strea, Beijing 100124, Peoples R China
  • [ 5 ] [Ge, Hui]Beijing Univ Technol, Coll Comp Sci & Technol, Beijing Key Lab Integrat & Anal Large Scale Strea, Beijing 100124, Peoples R China
  • [ 6 ] [Chen, Juncheng]Beijing Univ Technol, Coll Comp Sci & Technol, Beijing Key Lab Integrat & Anal Large Scale Strea, Beijing 100124, Peoples R China

通讯作者信息:

  • 杨震

    [Yang, Zhen]Beijing Univ Technol, Coll Comp Sci & Technol, Beijing Key Lab Trusted Comp, Beijing 100124, Peoples R China

查看成果更多字段

相关关键词:

相关文章:

来源 :

PROCEEDINGS OF ELM-2015, VOL 1: THEORY, ALGORITHMS AND APPLICATIONS (I)

ISSN: 2363-6084

年份: 2016

卷: 6

页码: 371-381

语种: 英文

被引次数:

WoS核心集被引频次: 3

SCOPUS被引频次:

ESI高被引论文在榜: 0 展开所有

万方被引频次:

中文被引频次:

近30日浏览量: 3

在线人数/总访问数:248/3704042
地址:北京工业大学图书馆(北京市朝阳区平乐园100号 邮编:100124) 联系我们:010-67392185
版权所有:北京工业大学图书馆 站点建设与维护:北京爱琴海乐之技术有限公司