Infrared enhancement is one of the effective methods to improve the quality of infrared imaging and highlight target information. The visual saliency map is calculated in a local window to help achieve the enhancement of the infrared image. Firstlysaliency is measured using center-surrounding pixel gray weight distance method within a local image region. Secondlysaliency map is obtained to simulate human visual system to assign weights to different pixel areas. Finallyinfrared image enhancement is achieved based on saliency map extraction. Several sets of infrared images are selected for experimentsand both subjective and objective evaluation methods are adopted to evaluate multiple enhancement methods. Compared with other methodsthe experimental results show that the results of the proposed method has better visual effectscan highlight the details especially the target informationand can effectively achieve contrast enhancement between the target and the background.