• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
搜索

Author:

Cao, Yetong (Cao, Yetong.) | Li, Fan (Li, Fan.) | Chen, Huijie (Chen, Huijie.) | Liu, Xiaochen (Liu, Xiaochen.) | Duan, Chunhui (Duan, Chunhui.) | Wang, Yu (Wang, Yu.)

Indexed by:

EI Scopus

Abstract:

Recent literature advances motion sensors mounted on smartphones and AR/VR headsets to speech eavesdropping due to their sensitivity to subtle vibrations. The popularity of motion sensors in earphones has fueled a rise in their sampling rate, which enables various enhanced features. This paper investigates a new threat of eavesdropping via motion sensors of earphones by developing EarSpy, which builds on our observation that the earphone's accelerometer can capture bone conduction vibrations (BCVs) and ear canal dynamic motions (ECDMs) associated with speaking; they enable EarSpy to derive unique information about the wearer's speech. Leveraging a study on the motion sensor measurements captured from earphones, EarSpy gains abilities to disentangle the wearer's live speech from interference caused by body motions and vibrations generated when the earphone's speaker plays audio. To enable user-independent attacks, EarSpy involves novel efforts, including a trajectory instability reduction method to calibrate the waveform of ECDMs and a data augmentation method to enrich the diversity of BCVs. Moreover, EarSpy explores effective representations from BCVs and ECDMs, and develops a convolutional neural model with Connectionist Temporal Classification (CTC) to realize accurate speech recognition. Extensive experiments involving 14 participants demonstrate that EarSpy reaches a promising recognition for the wearer's speech. © 2023 IEEE.

Keyword:

Loudspeakers Security systems Speech recognition

Author Community:

  • [ 1 ] [Cao, Yetong]Beijing Institute of Technology, School of Computer Science and Technology, China
  • [ 2 ] [Li, Fan]Beijing Institute of Technology, School of Computer Science and Technology, China
  • [ 3 ] [Chen, Huijie]Beijing University of Technology, Department of Computer Science, China
  • [ 4 ] [Liu, Xiaochen]Beijing Institute of Technology, School of Computer Science and Technology, China
  • [ 5 ] [Duan, Chunhui]Beijing Institute of Technology, School of Computer Science and Technology, China
  • [ 6 ] [Wang, Yu]Temple University, Department of Computer and Information Sciences, United States

Reprint Author's Address:

Email:

Show more details

Related Keywords:

Related Article:

Source :

ISSN: 0743-166X

Year: 2023

Volume: 2023-May

Language: English

Cited Count:

WoS CC Cited Count:

SCOPUS Cited Count: 11

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 0

Affiliated Colleges:

Online/Total:767/5430453
Address:BJUT Library(100 Pingleyuan,Chaoyang District,Beijing 100124, China Post Code:100124) Contact Us:010-67392185
Copyright:BJUT Library Technical Support:Beijing Aegean Software Co., Ltd.