• 综合
  • 标题
  • 关键词
  • 摘要
  • 学者
  • 期刊-刊名
  • 期刊-ISSN
  • 会议名称
搜索

作者:

Jia, Xibin (Jia, Xibin.) (学者:贾熹滨) | Yin, Baocai (Yin, Baocai.) (学者:尹宝才) | Sun, Yanfen (Sun, Yanfen.) | Lin, Xianpin (Lin, Xianpin.)

收录:

EI Scopus

摘要:

The paper introduces a speech-driven visual speech synthesis system. The loosing-coupled-mapping scheme is proposed to establish the correspondence between the acoustic speech class and the visual speech class. Employing the data-driven method in the recorded video enables one learn the mapping scheme. To enhance the correlation between the vocal and the visual speech, the articulatory-lip-correlative-speech mode is extracted by using the genetic algorithm. The results show that the extracted feature can make the corresponding lip image class have a good clustering performance. At the synthesis phase, the serial smooth lip images are received by the searching approach in accordance with the input speech. Compared with the original video, the experiment shows that synthetic visual speech achieves a good result. Moreover, further research should be done at the synthesis phase in order to correct the jerky phenomena.

关键词:

Feature extraction Genetic algorithms Human computer interaction Learning systems Speech processing Speech synthesis Visual communication

作者机构:

  • [ 1 ] [Jia, Xibin]Beijing Municipal Key Laboratory of Multimedia and Intelligent Software Technology, Beijing University of Technology, Beijing 100022, China
  • [ 2 ] [Yin, Baocai]Beijing Municipal Key Laboratory of Multimedia and Intelligent Software Technology, Beijing University of Technology, Beijing 100022, China
  • [ 3 ] [Sun, Yanfen]Beijing Municipal Key Laboratory of Multimedia and Intelligent Software Technology, Beijing University of Technology, Beijing 100022, China
  • [ 4 ] [Lin, Xianpin]Beijing Municipal Key Laboratory of Multimedia and Intelligent Software Technology, Beijing University of Technology, Beijing 100022, China

通讯作者信息:

电子邮件地址:

查看成果更多字段

相关关键词:

相关文章:

来源 :

Journal of Information and Computational Science

ISSN: 1548-7741

年份: 2006

期: 2

卷: 3

页码: 227-234

被引次数:

WoS核心集被引频次: 0

SCOPUS被引频次:

ESI高被引论文在榜: 0 展开所有

万方被引频次:

中文被引频次:

近30日浏览量: 2

在线人数/总访问数:242/2892027
地址:北京工业大学图书馆(北京市朝阳区平乐园100号 邮编:100124) 联系我们:010-67392185
版权所有:北京工业大学图书馆 站点建设与维护:北京爱琴海乐之技术有限公司