• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
搜索

Author:

Chen, Jiaming (Chen, Jiaming.) | Wang, Dan (Wang, Dan.) | Hu, Bo (Hu, Bo.) | Yi, Weibo (Yi, Weibo.) | Xu, Meng (Xu, Meng.) | Chen, Dingrui (Chen, Dingrui.) | Zhao, Qing (Zhao, Qing.)

Indexed by:

EI Scopus

Abstract:

Motor Imagery-based Brain Computer Interface (MI-BCI) is a typical active BCI with a main focus on motor intention identification. Hybrid motor imagery (MI) decoding methods that based on multi-modal fusion of Electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS), especially deep learning-based methods, become popular in recent MI-BCI studies. However, the fusion strategy and network design in deep learning-based methods are complex. To solve this problem, we proposed the multi-channel fusion method (MCF) to simplify current fusion methods, and we designed a multi-channel fusion hybrid network (MCFHNet) based on MCF. MCFHNet combines depthwise convolutional layers, channel attention mechanism, and Bidirectional Long Short Term Memory (Bi-LSTM) layers, which enables strong capability of feature extraction in spatial and temporal domain. The comparison between MCFHNet and representative deep learning-based methods was performed on an open EEG-fNIRS dataset. We found the proposed method can yield superior performance (mean accuracy of 99.641 % in 5-fold cross validation of an intra-subject experiment). This work provides a new option for multi-modal MI decoding, which can be applied in the rehabilitation field based on hybrid BCI systems. © 2022 IEEE.

Keyword:

Brain Infrared devices Electrophysiology Decoding Learning systems Electroencephalography Near infrared spectroscopy Long short-term memory Brain computer interface

Author Community:

  • [ 1 ] [Chen, Jiaming]Beijing University of Technology, Faculty of Information Technology, Beijing, China
  • [ 2 ] [Wang, Dan]Beijing University of Technology, Faculty of Information Technology, Beijing, China
  • [ 3 ] [Hu, Bo]Beijing University of Technology, Faculty of Information Technology, Beijing, China
  • [ 4 ] [Yi, Weibo]Beijing Machine and Equipment Institute, Beijing, China
  • [ 5 ] [Xu, Meng]Beijing University of Technology, Faculty of Information Technology, Beijing, China
  • [ 6 ] [Chen, Dingrui]James Watt School of Engineering, University of Glasgow, Glasgow, United Kingdom
  • [ 7 ] [Zhao, Qing]Beijing University of Technology, Faculty of Information Technology, Beijing, China

Reprint Author's Address:

Email:

Show more details

Related Keywords:

Related Article:

Source :

ISSN: 1557-170X

Year: 2022

Volume: 2022-July

Page: 4821-4825

Language: English

Cited Count:

WoS CC Cited Count:

SCOPUS Cited Count: 4

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 2

Affiliated Colleges:

Online/Total:1191/5267546
Address:BJUT Library(100 Pingleyuan,Chaoyang District,Beijing 100124, China Post Code:100124) Contact Us:010-67392185
Copyright:BJUT Library Technical Support:Beijing Aegean Software Co., Ltd.