Aiming at the problem of low detection accuracy of small target in infrared target detectionan improved Average Absolute Gray Difference (AAGD) algorithm is proposed to detect small infrared targets. Firstlyin view of the shortcomings of aagd algorithmon the basis of itthe gray and saliency features are fused and used in the kernel correlation filter to solve the problem of simple features and less information of infrared target. Thenan adaptive double sliding window is proposedwhich adjusts the shape of the aggregation window and the weight of pixels according to different regions to realize the matching of maneuvering targets near the background of high-intensity structure and improve the accuracy of small target detection. FinallyExperimental demonstration of the proposed method based on the MATLAB simulation platform shows that the proposed method can accurately detect small targets in complex images such as noisehigh-intensity sharp edges and structural backgroundsand its accuracystability and execution time are better than other comparison methods.