Optical Technique, Volume. 50, Issue 3, 269(2024)

A polarization video super-resolution method combining enhanced alignment and multi attention fusion

XU Guoming1,2,3、*, JIN Miao1, LIANG Dong4,5, MA Jian4,5, WANG Feng6, and LI Yi7
Author Affiliations
  • 1[in Chinese]
  • 2[in Chinese]
  • 3[in Chinese]
  • 4[in Chinese]
  • 5[in Chinese]
  • 6[in Chinese]
  • 7[in Chinese]
  • show less

    In polarization imaging detection,polarization multi-channel video sequence brings challenges to data transmission and processing,while detection accuracy depends on high-resolution images.Therefore,super resolution computing imaging becomes the key technology of polarization imaging detection system.A polarization video super-resolution reconstruction method is proposed based on enhanced alignment and multi-attention fusion.A three-level cascade structure is adopted to achieve feature alignment.Each level of features is obtained by twice downsampling of the upper level features,and feature alignment is performed by using deformable convolution guided by optical flow; In the fusion stage,multiple attention mechanisms,including temporal attention,spatial attention and channel attention,are combined to make full use of inter channel dependency and spatiotemporal correlation to improve the effect of super-resolution reconstruction.qualitative and quantitative comparative experiments were conducted between the method proposed and other video super-resolution methods,such as VSR-DUF,RBPN,EDVR,RLSP,RSDN,RRN,DARN,MSAWN,on 0°,45°,90°,135°polarized videos.Experiments show that the method outperforms other algorithms in terms of peak signal-to-noise ratio and structural similarity metrics,and that the high-frequency texture detail restoration of video frames is richer and closer to the original HD image frames from the polarization imaging system.

    Tools

    Get Citation

    Copy Citation Text

    XU Guoming, JIN Miao, LIANG Dong, MA Jian, WANG Feng, LI Yi. A polarization video super-resolution method combining enhanced alignment and multi attention fusion[J]. Optical Technique, 2024, 50(3): 269

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Received: Jul. 1, 2023

    Accepted: --

    Published Online: Aug. 14, 2024

    The Author Email: Guoming XU (xgm121@163.com)

    DOI:

    Topics