To make full use of object targeting information in infrared image, the algorithm based on fractal feature and guided filtering is presented to fuse visible and infrared image. The proposed algorithm adopts fractal feature to perform man-made object enhancement in infrared image first, and then gets object distribution picture through threshold segmentation. The approximation image and detail image are obtained by one-level decomposition of images to be fused, and the fusion coefficients are obtained by guided filtering based on object distribution picture. The experimental results demonstrate that, the fused image combines background information from visible image and object information from infrared image fully, and can be beneficial for object recognition tasks further.