• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
搜索

Author:

Li, Mi (Li, Mi.) (Scholars:栗觅) | Zhang, Wei (Zhang, Wei.) | Hu, Bin (Hu, Bin.) | Kang, Jiaming (Kang, Jiaming.) | Wang, Yuqi (Wang, Yuqi.) | Lu, Shengfu (Lu, Shengfu.)

Indexed by:

EI Scopus SCIE

Abstract:

At present, there have beenmany studies on themethods of using the deep learning regression model to assess depression level based on behavioral signals (facial expression, speech, and language); however, the research on the assessment method of anxiety level using deep learning is absent. In this article, pupil-wave, a physiological signal collected by Human Computer Interaction (HCI) that can directly represent the emotional state, is developed to assess the level of depression and anxiety for the first time. In order to distinguish between different depression and anxiety levels, we use the HCI method to induce the participants' emotional experience through three virtual reality (VR) emotional scenes of joyful, sad, and calm, and construct two differential pupil-waves of joyful and sad with the calm pupil-wave as the baseline. Correspondingly, a dual-channel fusion depression and anxiety level assessment model is constructed using the improved multi-scale convolution module and our proposed width-channel attention module for one-dimensional signal processing. The test results show that the MAE/RMSE of the depression and anxiety level assessment method proposed in this article is 3.05/4.11 and 2.49/1.85, respectively, which has better assessment performance than other related research methods. This study provides an automatic assessment technique based on human computer interaction and virtual reality for mental health physical examination.

Keyword:

width-channel attention module Deep learning pupil-wave Virtual reality (VR) Human computer interaction (HCI)

Author Community:

  • [ 1 ] [Li, Mi]Beijing Univ Technol, Engn Res Ctr Intelligent Percept & Autonomous Con, Beijing Int Collaborat Base Brain Informat & Wisd, Fac Informat Technol,Minist Educ,Engn Res Ctr Dig, Beijing, Peoples R China
  • [ 2 ] [Lu, Shengfu]Beijing Univ Technol, Engn Res Ctr Intelligent Percept & Autonomous Con, Beijing Int Collaborat Base Brain Informat & Wisd, Fac Informat Technol,Minist Educ,Engn Res Ctr Dig, Beijing, Peoples R China
  • [ 3 ] [Zhang, Wei]Beijing Univ Technol, Fac Informat Technol, Beijing, Peoples R China
  • [ 4 ] [Kang, Jiaming]Beijing Univ Technol, Fac Informat Technol, Beijing, Peoples R China
  • [ 5 ] [Wang, Yuqi]Beijing Univ Technol, Fac Informat Technol, Beijing, Peoples R China
  • [ 6 ] [Hu, Bin]Beijing Inst Technol, Inst Engn Med, Beijing, Peoples R China
  • [ 7 ] [Hu, Bin]Lanzhou Univ, Sch Informat Sci & Engn, Gansu Prov Key Lab Wearable Comp, Lanzhou, Peoples R China

Reprint Author's Address:

  • [Hu, Bin]Beijing Inst Technol, Inst Engn Med, Beijing, Peoples R China;;[Hu, Bin]Lanzhou Univ, Sch Informat Sci & Engn, Gansu Prov Key Lab Wearable Comp, Lanzhou, Peoples R China

Show more details

Related Keywords:

Related Article:

Source :

ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS

ISSN: 1551-6857

Year: 2024

Issue: 2

Volume: 20

5 . 1 0 0

JCR@2022

Cited Count:

WoS CC Cited Count:

SCOPUS Cited Count: 50

ESI Highly Cited Papers on the List: 6 Unfold All

  • 2024-11
  • 2024-11
  • 2024-9
  • 2024-9
  • 2024-7
  • 2024-5

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 0

Affiliated Colleges:

Online/Total:702/5295708
Address:BJUT Library(100 Pingleyuan,Chaoyang District,Beijing 100124, China Post Code:100124) Contact Us:010-67392185
Copyright:BJUT Library Technical Support:Beijing Aegean Software Co., Ltd.