Ship transportation has promoted the development of trade and logistics while also emitting pollutants into the atmosphere. This study developed a ground-based rapid imaging spectral detection system for tracking and monitoring real-time ship emissions. The system uses both visible light and ultraviolet telescopic lenses. The former works with the gimbal to locate and track target ships, while the latter collects specific spectral data of ship emissions. Adjusting the camera orientation based on the ships real-time position, and continuously capturing multiple images to establish a time series background and spectral dataset. Improvements have been made to the fiber optic spectrometer, which improves the systems spectral imaging speed and enables the acquisition of high temporal resolution monitoring data. At the same time, it can adapt to ship movements and environmental changes, ensuring the accuracy and continuity of data. Using imaging differential absorption spectroscopy technology, the concentrations of SO2 and NO2 in ship emissions can be identified and quantified. Field observations were conducted on ship pollution gas emissions in the Yangtze River Basin of Tongling City to verify the system performance. The results showed that the inclined column density of SO2 in ship emissions was 5.64×1016 molecule·cm-2, and the inclined column density of NO2 was 8.75×1016 molecule·cm-2, which verified the feasibility of the detection system.