With the development of infrared imaging technology, the resolution and frame rate of infrared imaging detection equipments are getting higher and higher, which leads to image processing systems shall have more powerful data processing capability. A multi-channel infrared image processing system is designed based on FPGA, DSP and CPU. And the acquisition, transmission, processing and mass storage of five-channel infrared images is realized, which meet the image processing requirements of multi-channel infrared detection equipments. It is verified by practical application that the system has stable operation and good operation effect.