Concerning the poor fusion quality of the infrared and visible light outdoors image, an infrared and visible light outdoors image fusion method based on convolutional neural network is proposed. Firstly, this method makes use of rolling guidance filter to preprocess the input infrared image, so that the noise is filtered and the useless information is eliminated. Then, the Curvelet transformation is used to decompose the infrared image and visible light image, the images are decomposed to high frequency coefficients and low frequency coefficients, the deep feature fusion rule based on convolutional neural networks is utilized to fuse high frequency coefficients, and the minimum fusion rule is utilized to fuse low frequency coefficients. Experimental results show that the images fused by the proposed method achieve better subjective visual quality and objective quantitative result.