Aiming at the real-time requirements of image fusion in the infrared and visible light, a real-time implementation method to solve the current high-definition or ultrahigh-definition multi-source Laplacian pyramid image fusion was proposed. Based on the video data stream, a parallel processing pipeline architecture of Laplacian pyramid system was designed. The time delay and optimization ideas between the pipelines were analyzed. All the delay time differences were compensated through on-chip cache to achieve the equal length of pipeline and guarantee the integrity of data processing in the whole algorithm. This method could realize 5-level Laplacian pyramid fusion of dual-channel 1080×1920@60 Hz video images on XILINX 7 series field programmable gate array (FPGA) and above. The experimental results show that this real-time method has better fusion effect, with only 10.535 ms of one-frame image fusion and the processing delay is less than 1 ms.