Infrared scanning imaging is necessary in remote sensing field. To improve the spatial resolution of infrared scanning image as much as possible, the applying research of Super Resolution Reconstruction (SRR) in infrared scanning imaging systems become the hot research point. Applying infrared scanning imaging system arranges dislocated multi-line array, through the procedure of SRR and the ways of getting the image sequence to be reconstructed, the key of improving the spatial resolution by SRR in the adopted experiment device are analyzed. The experiment shows that, as to the experiment device, the key factor affecting the quality of the reconstructed image is the noise caused by the large difference of the pixel value in the relative location in the image sequence. The comparative filter method based on the pixel of the image sequences can improve the quality of reconstructed image.