In　this　paper,　the　radial　basis　function　(RBF)　neural　network　is　employed　to　track　the　human　motion　and　predict　the　human　body　gesture.　Some　tests　and　comparison　experiments　have　been　made　to　evaluate　the　performance　for　the　motion　tracking　and　gesture　prediction　using　collected　motion　data.　The　experimental　results　show　that　the　RBF　neural　network　based　motion　tracking　and　gesture　prediction　methods　is　feasible.