• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
搜索

Author:

Cao, Yetong (Cao, Yetong.) | Li, Fan (Li, Fan.) | Chen, Huijie (Chen, Huijie.) | Liu, Xiaochen (Liu, Xiaochen.) | Wang, Yu (Wang, Yu.)

Indexed by:

EI Scopus SCIE

Abstract:

Past tongue-jaw movement interaction systems typically require dedicated hardware and are uncomfortable to use, limiting their scalability and generalizability. This paper introduces CanalScan, the first system that recognizes tongue-jaw movements using commodity speakers and microphones mounted on ubiquitous off-the-shelf devices (e.g., smartphones). What inspires us is that tongue-jaw movements always cause ear canal deformations, and we find that for different tongue-jaw movements, dynamic features of ear canal deformations present unique patterns on acoustic reflections in the ear canal. Specifically, CanalScan first sends an acoustic signal to the ear canal, then parses the reflection signals for tongue-jaw movements recognition. To eliminate the impacts of body movements, we develop a body movement noise filtering method and a dynamic segmentation method to identify and separate the tongue-jaw movements-associated ear canal deformations from other types of body movements. We further propose a sensor position detection method and a data transformation mechanism to reduce the impacts of diversities in-ear canal shapes and relative positions between sensors and the ear canal. CanalScan explores twelve unique and consistent features and applies a random forest classifier to distinguish tongue-jaw movements. Extensive experiments with twenty participants validate the generalizability, effectiveness, robustness, and high accuracy of CanalScan.

Keyword:

Human-computer interaction random forest tongue-jaw movement multi-path reflection

Author Community:

  • [ 1 ] [Cao, Yetong]Beijing Inst Technol, Sch Comp Sci, Beijing 100081, Peoples R China
  • [ 2 ] [Li, Fan]Beijing Inst Technol, Sch Comp Sci, Beijing 100081, Peoples R China
  • [ 3 ] [Liu, Xiaochen]Beijing Inst Technol, Sch Comp Sci, Beijing 100081, Peoples R China
  • [ 4 ] [Chen, Huijie]Beijing Univ Technol, Sch Comp Sci, Beijing 100124, Peoples R China
  • [ 5 ] [Wang, Yu]Temple Univ, Dept Comp & Informat Sci, Philadelphia, PA 19122 USA

Reprint Author's Address:

  • [Li, Fan]Beijing Inst Technol, Sch Comp Sci, Beijing 100081, Peoples R China;;

Show more details

Related Keywords:

Related Article:

Source :

IEEE TRANSACTIONS ON MOBILE COMPUTING

ISSN: 1536-1233

Year: 2024

Issue: 1

Volume: 23

Page: 879-894

7 . 9 0 0

JCR@2022

Cited Count:

WoS CC Cited Count:

SCOPUS Cited Count: 3

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 0

Affiliated Colleges:

Online/Total:731/5430145
Address:BJUT Library(100 Pingleyuan,Chaoyang District,Beijing 100124, China Post Code:100124) Contact Us:010-67392185
Copyright:BJUT Library Technical Support:Beijing Aegean Software Co., Ltd.