The speckle correlation technique (SCT), a non-invasive scattering imaging technique, has attracted widespread attention but is limited by the requirement of narrowband illumination. To address this drawback, we propose a broadband scattering imaging method based on speckle frequency refinement, which can effectively extract the useful components of speckle under broadband illumination. We verified its effectiveness through experiments with 10nm -400nm bandwidth illumination. Notably, even under 400nm bandwidth illumination, comparable to white light, the structural similarity index measure (SSIM) of the reconstruction by our method can stay above 0.6. This method can reconstruct the object using single -shot broadband speckle, demonstrating its potential advantages in practical applications.