According to the detection of small targets of infrared image in the sky, in order to improve the real time of detection, a algorithm of realizing image preprocess is proposed by Field Programmable Gate Array (FPGA). The FPGA achieves the morphological filter of mathematics, the image segmentation and the run length code. The experimental results indicate that the method is excellent in real time. It is effective for detecting small targets in infrared image.