The image fusion method based on contrast pyramid decomposition has good physical meaning, but there is no emphasis on direction. An image fusion method based on directional contrast pyramid decomposition is proposed. The contrast pyramid decomposition of multi-focus images is performed. Multiple directional sub-images are obtained for each high frequency image by using directional filter banks. According to the characteristics of different frequency domain, the decomposed sub-images are fused, and the fusion rule is that the weighted average value is selected for low frequency sub-band coefficients, while for high frequency sub-band coefficients, the coefficients with larger absolute value are employed. Results show that the fused images obtained by the proposed method have high definition and spatial resolution. Compared to the fusion methods based on the contrast pyramid (CP) decomposition and discrete wavelet transform (DWT), the proposed method can not only keep the meaning of contrast, but also provide 2n direction information.