Acta Optica Sinica, Volume. 41, Issue 21, 2133001(2021)

Orthogonal Color Transfer with Depth Feature Fusion for True-Color EMCCD

Ke Ding1, Wenqu Zhao1, Yi Cai1, Fang Dai2, Jie Xu2, Jiandong Xu2, and Lingxue Wang1、*
Author Affiliations
  • 1MoE Key Laboratory of Photoelectronic Imaging Technology and System, School of Optics and Photonics, Beijing Institute of Technology, Beijing 10081, China
  • 2Integrated Circuit Design Department, East China Institute of Optoelectronic Integrated Device, Suzhou, Jiangsu 215163, China
  • show less
    Figures & Tables(17)
    Schematic diagram of orthogonal color transfer model in orthogonal color space
    Numerically indistinguishable clusters are separated in deep feature space
    Flow chart of the proposed orthogonal color transfer network with deep feature fusion
    Deep features extracted by the pre-trained VGG16 network as front-end network
    Framework of fully connected network for deep feature fusion proposed for color transfer
    Experimental equipment. (a) Spectral transmission of optical filters; (b) filter wheel; (c) normalized spectral sensitivity of EMCCD camera
    Illustration of proposed network
    Test results on 16 source-reference image pairs
    Evaluation of predictions on 16 test image pairs
    Comparison of model prediction results
    Training loss curves of orthogonal color space ablation test
    Comparison of prediction results of ablation tests
    Part of comparative experimental results
    Color transfer results of EMCCD source images captured under illumination of 0.1--1 lx
    Color transfer result of the EMCCD source images captured under illumination of 0.01 lx
    • Table 1. Parameters of proposed network

      View table

      Table 1. Parameters of proposed network

      VGG16 encodersColor decoders
      NameLayerFeature map shapeNameLayerParameter shape
      [Tanh(·)+1.]/2.0
      v1No.264×H×WD1Tanh[Conv2d(·)]64×1×1×3
      Bilinear Upsample2×0
      v2No.7128×H/2×W/2D2Tanh[Conv2d(·)]128×1×1×3
      Bilinear Upsample2×0
      v3No.12256×H/4×W/4D3Tanh[Conv2d(·)]256×1×1×3
      Bilinear Upsample2×0
      v4No.19512×H/8×W/8D4Tanh[Conv2d(·)]512×1×1×3
      FTanh[Conv2d(·)]512×1×1×3
    • Table 2. Objective evaluation of comparative experimental results

      View table

      Table 2. Objective evaluation of comparative experimental results

      MethodPSNRSSIMACDUIQMUCIQEBIQIBLIINDSNIQEBRISQUE
      Ours24.01550.557928.96592.5462106.602946.880237.65636.812156.2530
      Ref. [19]13.74480.4264259.61442.137977.841042.376137.15636.078052.5676
      Ref. [20]13.09140.3459256.34452.165372.152738.277428.93755.965447.2980
      Ref. [14]17.18010.4120116.26032.308594.779644.462631.56254.958742.8043
      Ref. [21]13.84200.4206234.48701.858472.110944.627539.56257.069053.7486
      Ref. [22]13.55490.4214281.36602.228473.658242.848331.93755.754250.6957
    Tools

    Get Citation

    Copy Citation Text

    Ke Ding, Wenqu Zhao, Yi Cai, Fang Dai, Jie Xu, Jiandong Xu, Lingxue Wang. Orthogonal Color Transfer with Depth Feature Fusion for True-Color EMCCD[J]. Acta Optica Sinica, 2021, 41(21): 2133001

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Vision, Color, and Visual Optics

    Received: Mar. 24, 2021

    Accepted: May. 18, 2021

    Published Online: Nov. 21, 2021

    The Author Email: Wang Lingxue (neobull@bit.edu.cn)

    DOI:10.3788/AOS202141.2133001

    Topics