In a scattering environment, the optical imaging technology often encounters considerable degradation in image quality, exhibiting diminished contrast for details. This limitation has hindered its broader application across various domains. Due to the partial polarization of scattered light, polarization-based scatter removal techniques have received extensive attention and applications in recent years. However, the restoration effect of traditional polarization-based scatter removal methods heavily relies on the polarization light content of scenes, posing challenges for achieving desired scatter removal effect in complex scenarios. To address this limitation and improve the applicability of polarization-based methods, this paper focuses on the regional details of polarized images and proposes a new method for scatter removal based on regional detail enhancement. By combining contrast and the Stokes vector, this method identified two subpolarized images to be restored and estimated the crucial parameters of the model via frequency-domain processing. Subsequently, an undegraded image was recovered using a scattering degradation model, and the final scatter-free image was generated through proportional fusion. Experimental results demonstrate that the proposed method exhibits a good restoration performance in various scattering environments, such as haze or turbid water, and across different scattering levels, thereby improving the applicability of polarization algorithms. Additionally, the proposed method fully utilizes the regional information of polarized images, highlighting strongly polarized regions in the original image. Moreover, it can simultaneously restore high- and low-polarization target objects and enhance image details.