For the high spatial resolution remote sensing image, the size is vast, the object features are abundant and the edge information is complex. According to its characteristics, a fast adaptive interpolation algorithm applied to the high spatial resolution remote sensing image is proposed. The new algorithm classifies the interpolative dots according to the parity of the coordinate, and gets edges of the original image by applying the Canny operator. Every rectangular area comprised of four neighboring pixel is classified into five types in accordance with the edge characteristics, and the fast interpolation is finished for different types of the interpolative dots. The relationship among pixel of the original image and the assigned interpolation points are used to assign values to the rest dots. Experimental results show that the new algorithm can not only have a low computational complexity, but also accurately preserve edges and prevent blur. In addition, it can effectively enhance the low peak signal to noise ratio. The new algorithm has high practical value to researches on interpolation algorithm of the remote sensing image.