In　this　paper　we　present　a　new　use　of　a　new　kind　of　stochastic　learning　automaton　called　a　Skinner　automaton　as　a　psychological　model　to　formalize　the　theory　of　operant　conditioning.　The　animal　operant　learning　is　identified　with　a　thermodynamic　process,　and　a　so-called　Skinner　algorithm　from　Monte　Carlo　method　and　Metropolis　algorithm　as　well　as　simulated　annealing　is　derived.　In　this　paper,　the　Skinner　automaton　is　implemented　on　tracking　a　target　to　show　its　wide　usage.