At　present,　the　speech　enhancement　algorithm　in　binaural　digital　hearing　aids　is　mainly　based　on　adaptive　beamforming　algorithm.　This　algorithm　strongly　depends　on　the　environment.　And　the　enhancement　performance　is　not　satisfactory,　which　makes　it　difficult　for　hearing　loss　people　to　get　high　intelligibility　and　comfort　speech.　To　solve　this　problem,　a　binaural　speech　enhancement　algorithm　based　on　sound　source　localization　and　scene　matching　is　proposed　in　this　paper.　First,　the　spatial　information　of　sound　source　is　extracted　by　the　sound　source　localization　algorithm　based　on　head-related　transfer　function　and　Gaussian　mixture　model　classifier　with　Gammatone　filter　decomposition.　Second,　noise　in　different　directions　from　the　speaker　is　removed　by　spatial　filter.　Third,　the　type　of　noise　in　the　same　direction　from　the　speaker　is　recognized　by　the　scene　recognition　algorithm　based　on　multi-feature　and　weighted　minimum　distance　classifier.　Finally,　according　to　the　type　of　noise,　the　optimal　speech　enhancement　method　is　chosen　to　remove　this　noise.　Experiment　results　show　that　the　proposed　algorithm　has　better　robustness,　better　speech　enhancement　performance　and　lower　complexity　than　the　contrast　algorithm.