Acta Optica Sinica, Volume. 44, Issue 19, 1910001(2024)

Semantic-Guided Polarization Spectral Image Fusion Method for Camouflage Target Detection

Bangyong Sun1,2, Yuhan Shi1, and Tao Yu2、*
Author Affiliations
  • 1Faculty of Printing, Packaging Engineering and Digital Media Technology, Xi’an University of Technology, Xi’an 710054, Shaanxi , China
  • 2Key Laboratory of Spectral Imaging Technology, Xi’an Institute of Optics and Precision Mechanics, Chinese Academy of Sciences, Xi’an 710119, Shaanxi , China
  • show less
    Figures & Tables(18)
    Process of polarization spectral image fusion
    Equipment of polarization spectral imaging. (a) Camera prototype; (b) pixel arrangement diagram
    Pre-processing flowchart of polarization spectral imaging system
    Spectral analysis of camouflage targets. (a) Collected spectral cubes; (b) spectral curves of classic ground features in grassland background
    Image fusion process
    Polarization semantic guidance network structure
    Fusion process of non-downsampling contour wave transform
    Polarization characteristic images. (a) Intensity image I; (b) Stokes vector image Q; (c) Stokes vector image U; (d) DoLP image; (e) AoP image
    700 nm band images generated by different fusion methods. (a) Intensity image; (b) DWT method[23]; (c) GFF method[24]; (d) PCNN method[25]; (e) BFWLS method[26]; (f) LRD method[27]; (g) NSST method[28]; (h) NSCT method[18]; (i) proposed method
    Fusion performance of camouflage image under grassland background
    Ground truth image for annotated camouflage target
    Detection effects of camouflage targets
    Comparison of detection effect for different fusion methods and detection modes
    • Table 1. Quantitative evaluation results of selected-band images

      View table

      Table 1. Quantitative evaluation results of selected-band images

      MethodDWT[23]GFF[24]PCNN[25]BFWLS[26]LRD[27]NSST[28]NSCT[18]Proposed
      700 nmEN5.98186.15926.61116.27876.68916.38816.63766.7032
      AG6.236410.31648.55772.444110.12004.37338.789610.8808
      SD17.330621.524528.255824.976529.677725.312027.89630.2776
      SF22.706131.242624.39046.011830.871611.311526.824232.6753
      QAB/F0.26060.76560.45570.25910.58720.25220.60000.5285
      540 nmEN6.27646.18376.51796.42556.69046.50646.71466.8789
      AG6.998710.163010.08701.861210.06334.03089.99589.9292
      SD20.076120.183325.046324.870828.430425.168127.787230.3044
      SF27.161331.553431.21014.170831.578910.355431.365231.2458
      QAB/F0.40080.78720.62400.22600.58540.22620.60990.5282
      800 nmEN6.69736.45017.65827.66287.65347.62477.67447.7088
      AG4.46237.15106.35663.99976.34683.53347.14097.1490
      SD28.798227.964260.231961.409860.064360.725260.692861.3821
      SF17.583422.735318.54349.172720.13839.269522.678622.6543
      QAB/F0.27680.58740.35740.35820.32450.22850.38950.3689
    • Table 2. Running time of different fusion methods

      View table

      Table 2. Running time of different fusion methods

      MethodDWTGFFPCNNBFWLSLRDNSSTNSCTProposed
      Time /s7.436.4532.8024.941420.8568.97130.26132.41
    • Table 3. Objective evaluation indices for fusion images of metal plate

      View table

      Table 3. Objective evaluation indices for fusion images of metal plate

      MethodENAGSDSFQAB/F
      DWT5.35672.628810.30268.90420.2079
      GFF6.88055.531530.413715.48970.7205
      PCNN6.15605.351218.008114.78550.6898
      BFWLS6.62495.407026.644914.70450.7685
      LRD6.57125.048223.194913.29890.6647
      NSST6.54893.823023.03928.07450.3919
      NSCT6.62905.461424.456615.33610.7101
      Po-NSCT6.65046.083925.220916.70950.5460
    • Table 4. Results of ablation experiment

      View table

      Table 4. Results of ablation experiment

      Semantic guidanceFusion strategyENAGSDSFQAB/F
      6.63768.789627.896026.82420.6000
      6.67828.600228.618725.74430.3860
      6.649710.134328.974130.96370.6215
      6.703210.880830.277632.67530.5285
    • Table 5. Objective evaluation indices of camouflage target detection

      View table

      Table 5. Objective evaluation indices of camouflage target detection

      MethodIoUPreRecallAccF1
      Original image0.45520.47280.92440.95330.6256
      DWT0.45360.46050.96840.95420.6242
      GFF0.08800.09400.58150.91960.1618
      PCNN0.47330.48940.93490.95500.6425
      BFWLS0.47610.48020.98200.95640.6451
      LRD0.51010.52120.96020.95870.6756
      NSST0.49410.50630.95350.95720.6614
      NSCT0.47420.48530.95400.95560.6434
      Po-NSCT0.58760.60680.94880.96480.7263
      Fusion origin0.64830.70000.89760.96870.7866
      Fusion Po-NSCT0.80260.87780.90950.98270.8934
    Tools

    Get Citation

    Copy Citation Text

    Bangyong Sun, Yuhan Shi, Tao Yu. Semantic-Guided Polarization Spectral Image Fusion Method for Camouflage Target Detection[J]. Acta Optica Sinica, 2024, 44(19): 1910001

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Image Processing

    Received: Mar. 13, 2024

    Accepted: May. 20, 2024

    Published Online: Oct. 12, 2024

    The Author Email: Yu Tao (yutao@opt.ac.cn)

    DOI:10.3788/AOS240726

    CSTR:32393.14.AOS240726

    Topics