To improve image quality in complex and dim environments, a network that leverages both the global information and textural details of polarized images through a strategy of multi-scale feature extraction and dual fusion, known as the Scale Feature Extraction and Dual Fusion Strategy Network (SFE-DFS-Nest), is proposed. The proposed network fuses polarized intensity images with polarization degree images. Initially, an encoder is constructed to extract multi-scale features from source images. Then, shallow features are fused using a lightweight Transformer, while deep features are integrated through a residual network. Finally, a decoder is built to reconstruct the fused features. Compared with existing image fusion networks, this network employs distinct fusion strategies for features at different scales. The experimental results show that images from dark and complex environments exhibited improved subjective visual comfort after fusion through this network. Furthermore, the fused images obtained using the proposed method outperformed those obtained using the compared methods in terms of objective evaluation metrics.