According to the application requirement of information fusion for Digital Surface Model (DSM) data and visual remote sensing images, a two-level registration strategy based on Coherent Point Drift (CPD) algorithm and Relative Phase Histogram(RPH) was proposed to realize automatic registration of the data and images above. Firstly, Canny operator was used to extract edge points,and the extracted points were taken as inputs of CPT algorithm to implement a coarse matching and to obtain the initial matching points. Meanwhile, the scale factor was estimated. Then,the RPH, a robust descriptor characterized by invariance to image rotation and translation, was defined to represent the information of area changes. The RPH was also a scale-invariance under the support of coarse matching results. Finally, ring templates were defined in both images according to the scale factor and the fine registration of DSM data and remote sensing images was achieved by RPH measurement. Experimental results demonstrate that coarse matching results based on CPD are corrected efficiently after fine registration using RPH measurement. The registration error of proposed algorithm is only about two pixels even when images have perspective distortion. These data indicate that the method can satisfy the information fusion requirement of DSM data and visual remote sensing images.