Dynamic hand gesture recognition based on two-channel [基于双通道混合3D-2D RBM模型的手势识别] - 文章详情页

作者：

Li, J. (Li, J..) | Huai, H. (Huai, H..) | Kong, D. (Kong, D..) | Wang, L. (Wang, L..) | Sun, Y. (Sun, Y..)

收录：

Scopus PKU CSCD

摘要：

To　explore　the　intrinsic　spatio-temporal　representation　of　dynamic　hand　gesture　in　the　video-based　hand　gesture　recognition,　this　paper　proposed　a　3D-2D　restricted　Boltzmann　machine　(RBM)　model,　which　is　able　to　model　the　spatio-temporal　correlation　of　hand　gesture　video　data.　Especially,　a　method　combining　traditional　hand-defined　feature　with　3D-2D　RBM　was　proposed　to　describe　hand　gesture　better.　The　proposed　hybrid　3D-2D　RBM　model　consists　of　three　phases.　First,　Canny-2D　HOG　and　optical　flow　2D　HOG　were　used　to　describe　the　spatial　and　temporal　feature,　respectively.　A　3D-2D　RBM　was　then　adopted　to　learn　the　latent　high-level　semantics.　Finally,　the　two-channel　discrimination　results　were　fused　together　for　recognition.　The　experimental　results　on　the　public　Cambridge　Hand　Gesture　Data　set　show　that　the　proposed　hybrid　3D-2D　RBM　outperforms　the　state-of-the-art.　©　2019,　Editorial　Department　of　Journal　of　Beijing　University　of　Technology.　All　right　reserved.

关键词：

3D-2D restricted Boltzmann machine (RBM); Dynamic hand gesture recognition; Histogram of oriented gradient (HOG); Optical flow

作者机构：

[ 1 ] [Li, J.]Beijing Key Laboratory of Multimedia and Intelligent Software Technology, Faculty of Information Technology, Beijing University of Technology, Beijing, 100124, China
[ 2 ] [Huai, H.]Beijing Key Laboratory of Multimedia and Intelligent Software Technology, Faculty of Information Technology, Beijing University of Technology, Beijing, 100124, China
[ 3 ] [Kong, D.]Beijing Key Laboratory of Multimedia and Intelligent Software Technology, Faculty of Information Technology, Beijing University of Technology, Beijing, 100124, China
[ 4 ] [Wang, L.]Beijing Key Laboratory of Multimedia and Intelligent Software Technology, Faculty of Information Technology, Beijing University of Technology, Beijing, 100124, China
[ 5 ] [Sun, Y.]Beijing Key Laboratory of Multimedia and Intelligent Software Technology, Faculty of Information Technology, Beijing University of Technology, Beijing, 100124, China

通讯作者信息：

电子邮件地址：

查看成果更多字段

成果类型
所属机构

所有年份指定年份从至