• 综合
  • 标题
  • 关键词
  • 摘要
  • 学者
  • 期刊-刊名
  • 期刊-ISSN
  • 会议名称
搜索

作者:

Cao, Yetong (Cao, Yetong.) | Li, Fan (Li, Fan.) | Chen, Huijie (Chen, Huijie.) | Liu, Xiaochen (Liu, Xiaochen.) | Zhai, Shengchun (Zhai, Shengchun.) | Yang, Song (Yang, Song.) | Wang, Yu (Wang, Yu.)

收录:

EI Scopus SCIE

摘要:

Recent literature advances motion sensors mounted on smartphones and AR/VR headsets to speech eavesdropping due to their sensitivity to subtle vibrations. The popularity of motion sensors in earphones has fueled a rise in their sampling rate, which enables various enhanced features. This paper investigates a new threat of eavesdropping via motion sensors of earphones by developing EarSpy, which builds on our observation that the earphone's accelerometer can capture bone conduction vibrations (BCVs) and ear canal dynamic motions (ECDMs) associated with speaking; they enable EarSpy to derive unique information about the wearer's speech. Leveraging a study on the motion sensor measurements captured from earphones, EarSpy gains abilities to disentangle the wearer's live speech from interference caused by body motions and vibrations generated when the earphone's speaker plays audio. To enable user-independent attacks, EarSpy involves novel efforts, including a trajectory instability reduction method to calibrate the waveform of ECDMs and a data augmentation method to enrich the diversity of BCVs. Moreover, EarSpy explores effective representations from BCVs and ECDMs, and develops a neural network model with character-level and word-level speech recognition models to realize speech recognition. Extensive experiments involving 14 participants demonstrate that EarSpy reaches a promising recognition for the wearer's speech.

关键词:

neural network speech recognition Accelerometers Ear Dynamics Earphone Vibrations Headphones Speech recognition Motion detection motion sensor

作者机构:

  • [ 1 ] [Cao, Yetong]Beijing Inst Technol, Sch Comp Sci, Beijing 100081, Peoples R China
  • [ 2 ] [Li, Fan]Beijing Inst Technol, Sch Comp Sci, Beijing 100081, Peoples R China
  • [ 3 ] [Liu, Xiaochen]Beijing Inst Technol, Sch Comp Sci, Beijing 100081, Peoples R China
  • [ 4 ] [Zhai, Shengchun]Beijing Inst Technol, Sch Comp Sci, Beijing 100081, Peoples R China
  • [ 5 ] [Yang, Song]Beijing Inst Technol, Sch Comp Sci, Beijing 100081, Peoples R China
  • [ 6 ] [Chen, Huijie]Beijing Univ Technol, Sch Comp Sci, Beijing 100124, Peoples R China
  • [ 7 ] [Wang, Yu]Temple Univ, Dept Comp & Informat Sci, Philadelphia, PA 19122 USA

通讯作者信息:

查看成果更多字段

相关关键词:

相关文章:

来源 :

IEEE TRANSACTIONS ON MOBILE COMPUTING

ISSN: 1536-1233

年份: 2024

期: 6

卷: 23

页码: 7284-7300

7 . 9 0 0

JCR@2022

被引次数:

WoS核心集被引频次:

SCOPUS被引频次: 2

ESI高被引论文在榜: 0 展开所有

万方被引频次:

中文被引频次:

近30日浏览量: 0

归属院系:

在线人数/总访问数:276/4972004
地址:北京工业大学图书馆(北京市朝阳区平乐园100号 邮编:100124) 联系我们:010-67392185
版权所有:北京工业大学图书馆 站点建设与维护:北京爱琴海乐之技术有限公司