The　presentation　and　distribution　of　gray　matter　(GM)　and　white　matter　(WM)　abnormalities　in　temporal　lobe　epilepsy　(TLE)　have　been　widely　studied.　Here,　we　investigated　the　GM　and　WM　abnormalities　in　TLE　patients　with　and　without　hippocampal　sclerosis　(HS)　in　five　groups　of　participants:　healthy　controls　(HCs)　(n　=　28),　right　TLE　patients　with　HS　(n　=　26),　right　TLE　patients　without　HS　(n　=　30),　left　TLE　patients　with　HS　(n　=　25),　and　left　TLE　patients　without　HS　(n　=　27).　We　performed　a　flexible　factorial　statistical　test　in　a　whole-brain　voxel-based　morphometry　analysis　to　identify　significant　GM　and　WM　abnormalities　and　analysis　of　variance　of　hippocampal　and　amygdala　regions　among　the　five　groups　using　the　FreeSurfer　procedure.　Furthermore,　we　conducted　multiple　regression　analysis　to　assess　regional　GM　and　WM　changes　with　disease　duration.　We　observed　significant　ipsilateral　mesiotemporal　GM　and　WM　volume　reductions　in　TLE　patients　with　HS　compared　with　HCs.　We　also　observed　a　slight　GM　amygdala　swelling　in　right　TLE　patients　without　HS.　The　regression　analysis　revealed　significant　negative　GM　and　WM　changes　with　disease　duration　specifically　in　left　TLE　patients　with　HS.　The　observed　GM　and　WM　abnormalities　may　contribute　to　our　understanding　of　the　root　of　epilepsy　mechanisms.