A novel infrared image edge detection algorithm based on cellular neural networks on FPGA is proposed. First, the infrared image input module is to build with simulink. The relevant information of infrared image head is acquired, and the infrared image pixel value range is adjusted. Then CNN IP core is designed by lookup table which is created by the template of cellular neural networks. With the regularity and interconnection locality of cellular neural network array, the CNN IP core will be expanded into the cellular neural network array. Then the cellular neural network array is related with the infrared image input and output module by modelsim, so that the infrared image will be processed in real time. The experimental results showed: In the field programmable gate array hardware processor platforms such as the Virtex-6 FPGA of the Xilinx, the infrared image edge detection algorithm will be implementationed with cellular neural networks. The highest frequency of 142.693MHz is got, and the system processing speed of 2.378Mpixels/sec is reached.