Visual speech synthesis based on learning model - 文章详情页

作者：

Sun, Yan-Feng (Sun, Yan-Feng.) (学者：孙艳丰) | Lin, Xian-Ping (Lin, Xian-Ping.) | Yin, Bao-Cai (Yin, Bao-Cai.) (学者：尹宝才) | Jia, Xi-Bin (Jia, Xi-Bin.) (学者：贾熹滨)

收录：

EI Scopus PKU CSCD

摘要：

In　order　to　generate　more　realistic　mouth　animation　in　visual　speech　synthesis,　this　paper　proposed　a　method　based　on　a　two-level　learning　model.　The　authors　can　learn　the　potential　mapping　relationship　between　acoustic　features　and　the　visual　features　through　the　combination　of　HMM　(Hidden　Markov　Models)　and　GA　(Genetic　Algorithms).　This　model　can　decrease　the　redundant　information　in　abstracting　acoustic　features　for　large　acoustic　sample　space　and　predict　more　realistic　mouth　animation.　In　addition,　this　paper　also　proposed　a　new　method　based　on　FAP　points　in　mouth　feature　expression.　This　method　can　eliminate　the　effect　by　illumination　and　decrease　the　dimensions　of　mouth　feature　vector.　It　improves　the　speed　of　training　and　synthesis.

关键词：

Animation Feature extraction Genetic algorithms Hidden Markov models Learning systems Speech processing Speech recognition Speech synthesis

作者机构：

[ 1 ] [Sun, Yan-Feng]Beijing Municipal Key Laboratory of Multimedia and Intelligent Software Technology, College of Computer Sciences, Beijing University of Technology, Beijing 100124, China
[ 2 ] [Lin, Xian-Ping]Beijing Municipal Key Laboratory of Multimedia and Intelligent Software Technology, College of Computer Sciences, Beijing University of Technology, Beijing 100124, China
[ 3 ] [Yin, Bao-Cai]Beijing Municipal Key Laboratory of Multimedia and Intelligent Software Technology, College of Computer Sciences, Beijing University of Technology, Beijing 100124, China
[ 4 ] [Jia, Xi-Bin]Beijing Municipal Key Laboratory of Multimedia and Intelligent Software Technology, College of Computer Sciences, Beijing University of Technology, Beijing 100124, China

通讯作者信息：

电子邮件地址：

查看成果更多字段

成果类型
所属机构

所有年份指定年份从至