In　the　course　of　tracking　there　are　various　transformations　for　the　object,　including　flip,　rotation,　scaling,　shear　and　so　on.　In　this　paper,　we　describe　a　new　approach　that　can　perform　well　in　coping　with　object＇s　perspective　transformation.　A　transformation　matrix　which　is　modeled　with　9-parameter　matrix　is　employed　to　represent　the　deformation　of　the　object.　So　as　to　simplify　the　calculation　and　increase　the　speed　of　the　estimation　for　the　perspective　model,　we　choose　feature　points　for　calculation.　In　this　paper,　a　new　algorithm　is　proposed　to　remove　the　inaccurate　matching　points　and　calculate　the　final　perspective　parameters.　The　result　indicates　that　the　method　of　object　tracking　has　high　precision　and　fast　speed.