Aiming at the ghost problem in multi-exposure image fusion, a multi-scale exposure image fusion algorithm based on improved intensity mapping function is proposed. Firstly, the high and low contrast of the input frame is determined based on the reference frame image. Secondly, the high contrast region is used to detect the structure consistency to get the ghost area and the improved energy function based on the intensity mapping relationship is used to further detect the ghost information in the low contrast area. Finally, the multi-scale patch matching algorithm is used for fast fusion. Experimental results show that compared with the existing representative methods, the proposed method can effectively remove ghost region and retain the color and detail information of the image.