• 综合
  • 标题
  • 关键词
  • 摘要
  • 学者
  • 期刊-刊名
  • 期刊-ISSN
  • 会议名称
搜索

作者:

Jia, Xibin (Jia, Xibin.) (学者:贾熹滨) | Zhang, Kewei (Zhang, Kewei.) | Han, Yanfang (Han, Yanfang.) | Powers, David (Powers, David.)

收录:

EI Scopus

摘要:

Facing the requirement of the virtual pedagogy application to have the ability of evaluating English learners' pronunciation quality, the paper proposes an automatic assessment method based on a bimodal fusion decision algorithm. The pronunciation level is scored by comparing the similarity between learner and standard's audio and video speech signals separately. The final score of the learner's pronunciation is gotten by fusing the above scores with the linear weighting combination approach. Referring to the knowledge that the visual speech can aid the audio to improve the human perception especially under noisy environments, the paper proposes a noise adaptive weighting strategy in fusing process. To solve the problem of disagreement of speech length due to the various speaking speed, the paper adopts the dynamic warping algorithm to do the time alignment between the test speeches and the standard ones. The data selected from the Australia audio and visual speech corpus (AVOZES) is employed to test the performance of our automatic evaluating system. The experiment result shows that audio and visual speech fusion approach improves the rationality of automatic pronunciation accessing system by making full use of correlative and complementary information between acoustic and visual speech comparing to the audio-speech-only evaluation results. © 2012 AICIT.

关键词:

Acoustic noise Audio acoustics Quality control Speech

作者机构:

  • [ 1 ] [Jia, Xibin]Multimedia and Intelligent Software Technology, Beijing Municipal Key Laboratory, Beijing University of Technology, Beijing, China
  • [ 2 ] [Zhang, Kewei]Multimedia and Intelligent Software Technology, Beijing Municipal Key Laboratory, Beijing University of Technology, Beijing, China
  • [ 3 ] [Han, Yanfang]Multimedia and Intelligent Software Technology, Beijing Municipal Key Laboratory, Beijing University of Technology, Beijing, China
  • [ 4 ] [Powers, David]School of Computer Science, Engineering and Maths, Beijing University of Technology, Beijing, China
  • [ 5 ] [Powers, David]School of Computer Science, Engineering and Maths, Flinders University of South Australia, Adelaide, Australia

通讯作者信息:

电子邮件地址:

查看成果更多字段

相关关键词:

相关文章:

来源 :

年份: 2012

页码: 1244-1247

语种: 英文

被引次数:

WoS核心集被引频次: 0

SCOPUS被引频次:

ESI高被引论文在榜: 0 展开所有

万方被引频次:

中文被引频次:

近30日浏览量: 2

在线人数/总访问数:357/2894157
地址:北京工业大学图书馆(北京市朝阳区平乐园100号 邮编:100124) 联系我们:010-67392185
版权所有:北京工业大学图书馆 站点建设与维护:北京爱琴海乐之技术有限公司