Video　cataloging　is　the　main　technology　of　video　management　and　reuse.　It　helps　to　quickly　and　accurately　query　tapes　or　films　and　improves　work　efficiency　greatly.　However,　current　cataloging　is　performed　manually　because　existing　computer-aided　cataloging　system　can＇t　achieve　expected　accuracy　and　speed.　In　this　paper,　it　proposes　an　algorithm　to　control　video　structure　analysis　process　cleverly.　For　video　shot　boundary　detection,　it　put　forwards　Poisson　model　based　inter-frame　difference　histogram　to　generate　threshold.　For　video　scene　boundary　detection,　it　raises　variable-length　sliding　window　to　control　detection　process.　It　dynamically　adjusts　the　length　of　sliding　window　to　avoid　too　much　or　too　little　scene　segmentations.　Experiments　for　video　shot　and　scene　boundary　detection　show　its　efficiency　in　increasing　detection　accuracy.　©　2016　IEEE.