Quantum dot photodetector is a hot spot in current research, which has a wider spectral response range（350~2 000 nm）due to the use of special photosensitive materials. However, in the process of imaging chip preparation, because of the influence of the immature synthesis process and the low image element transplantation rate, the obtained images will have the image problems of blind flash element bunching and blurred details. Therefore, in this paper, in order to improve the quality of the image and attenuate the effects of the blind flash element noise and detail blurring in the image, we propose to enhance the wide-spectrum image with an adaptive median filtering algorithm and an inverse sharpening mask algorithm, and take advantage of the pipeline processing of the FPGA（Field Programmable Gate Array, FPGA）, which is deployed on the Xilinx A7 series hardware deployment. The results show that the peak signal-to-noise ratio of the processed image can be increased by 17% when a frame with a resolution of 640×512 is input. With a clock of 50 MHz, the processing takes about 6.16ms, which is of practical significance for the optimization of wide-spectrum imaging systems with high real-time performance and low hardware occupancy.