During the processing of infrared image information, the sampled image information should be pre-processed at first. According to 320×240 infrared detection chip of SOFRADIR company, the hardware design based on digital signal processor (DSP) and field programmable gate array (FPGA) image pre-processing system is introduced. And the non-uniformity algorithm of image pre-processing is researched. The collected infrared image signals is pre-processed on the hardware platform of image pre-processing system by two-point correction method of non-uniformity algorithm and better results are obtained. The rationality of the hardware system and the feasibility of the algorithm design are proved.