In order to enhance the outdoor blurred infrared image contrast, an infrared image enhancement based on haze remove method is proposed. The novel algorithm optimizes and improves the visual image haze remove method which combines the characteristics of the infrared images. In order to get the transmission rate coarse estimation, a fast average filtering using three levels Gaussian pyramid operation is presented. The haze free image is recovered through self- adaptive transmission rate calculated with the statistics information of image. To deal with low luminance problem of the whole haze free image, a sectional contrast enhancement way is proposed which is capable of background suppression. Experimental results show that the enhanced infrared image has more detail information and stronger gradient than the original and has a perfect visual effects. The objective evaluation parameters illustrate that the contrast of haze free infrared image increases effectively by the proposed algorithm. The proposed algorithm can realize real time infrared image enhancement processing, as embedded platform test takes 28 ms.