Photonics Research, Volume. 12, Issue 11, 2524(2024)

Predictive pixel-wise optical encoding: towards single-shot high dynamic range moving object recognition

Yutong He1,2, Yu Liang1,2, Honghao Huang1,2, Chengyang Hu1,2, Sigang Yang1,2, and Hongwei Chen1,2、*
Author Affiliations
  • 1Department of Electronic Engineering, Tsinghua University, Beijing 100084, China
  • 2Beijing National Research Center for Information Science and Technology (BNRist), Beijing 100084, China
  • show less
    References(43)

    [1] E. Reinhard, G. Ward, S. Pattanaik. High Dynamic Range Imaging: Acquisition, Display, and Image-Based Lighting(2010).

    [2] S. K. Nayar, T. Mitsunaga. High dynamic range imaging: spatially varying pixel exposures. IEEE Conference on Computer Vision and Pattern Recognition, 472-479(2000).

    [3] F. Dufaux, P. Le Callet, R. Mantiuk. High Dynamic Range Video: From Acquisition, to Display and Applications(2016).

    [4] Y.-L. Liu, W.-S. Lai, Y.-S. Chen. Single-image HDR reconstruction by learning to reverse the camera pipeline. IEEE/CVF Conference on Computer Vision and Pattern Recognition, 1651-1660(2020).

    [5] P. E. Debevec, J. Malik. Recovering high dynamic range radiance maps from photographs. 24th Annual Conference on Computer Graphics and Interactive Techniques, 369-378(1997).

    [6] F. Banterle, A. Artusi, K. Debattista. Advanced High Dynamic Range Imaging(2017).

    [7] S. W. Hasinoff, F. Durand, W. T. Freeman. Noise-optimal capture for high dynamic range photography. IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 553-560(2010).

    [9] E. Onzon, F. Mannan, F. Heide. Neural auto-exposure for high-dynamic range object detection. IEEE/CVF Conference on Computer Vision and Pattern Recognition, 7710-7720(2021).

    [10] Ce. Liu. Beyond Pixels: Exploring New Representations and Applications for Motion Analysis(2009).

    [12] Q. Yan, D. Gong, Q. Shi. Attention-guided network for ghost-free high dynamic range imaging. IEEE/CVF Conference on Computer Vision and Pattern Recognition, 1751-1760(2019).

    [13] T. Asatsuma, Y. Sakano, S. Iida. Sub-pixel architecture of CMOS image sensor achieving over 120 dB dynamic range with less motion artifact characteristics. International Image Sensor Workshop, R31(2019).

    [14] S. Iida, Y. Sakano, T. Asatsuma. A 0.68 e-rms random-noise 121 dB dynamic-range sub-pixel architecture CMOS image sensor with LED flicker mitigation. IEEE International Electron Devices Meeting (IEDM), 10.2.1-10.2.4(2018).

    [16] J. Han, C. Zhou, P. Duan. Neuromorphic camera guided high dynamic range imaging. IEEE/CVF Conference on Computer Vision and Pattern Recognition, 1730-1739(2020).

    [17] C. A. Metzler, H. Ikoma, Y. Peng. Deep optics for single-shot high-dynamic-range imaging. IEEE/CVF Conference on Computer Vision and Pattern Recognition, 1375-1385(2020).

    [18] Q. Sun, E. Tseng, Q. Fu. Learning rank-1 diffractive optics for single-shot high dynamic range imaging. IEEE/CVF Conference on Computer Vision and Pattern Recognition, 1386-1396(2020).

    [19] S. Hajisharif, J. Kronander, J. Unger. Adaptive dualiSO HDR reconstruction. EURASIP Journal on Image and Video Processing, 1-13(2015).

    [25] X. Hu, Z. Huang, A. Huang. A dynamic multi-scale voxel flow network for video prediction. IEEE/CVF Conference on Computer Vision and Pattern Recognition, 6121-6131(2023).

    [32] E. Reinhard, M. Stark, P. Shirley. Photographic tone reproduction for digital images. Seminal Graphics Papers: Pushing the Boundaries, 2, 661-670(2023).

    [36] D. Doherty, G. Hewlett. 10.4: Phased reset timing for improved digital micromirror device (DMD) brightness. SID Symposium Digest of Technical Papers 29, 125-128(1998).

    [37] W. Sun, C. Tang, Z. Yuan. A 112-765 GOPS/W FPGA-based CNN accelerator using importance map guided adaptive activation sparsification for pix2pix applications. IEEE Asian Solid-State Circuits Conference (A-SSCC), 1-4(2020).

    [40] M. Jaderberg, K. Simonyan, A. Zisserman. Spatial transformer networks. Advances in Neural Information Processing Systems, 1-9(2015).

    [42] Z. Wang, E. Simoncelli, A. Bovik. Multiscale structural similarity for image quality assessment. 37th Asilomar Conference on Signals, Systems & Computers, 2, 1398-1402(2003).

    [43] R. Zhang, P. Isola, A. A. Efros. The unreasonable effectiveness of deep features as a perceptual metric. IEEE Conference on Computer Vision and Pattern Recognition, 586-595(2018).

    Tools

    Get Citation

    Copy Citation Text

    Yutong He, Yu Liang, Honghao Huang, Chengyang Hu, Sigang Yang, Hongwei Chen, "Predictive pixel-wise optical encoding: towards single-shot high dynamic range moving object recognition," Photonics Res. 12, 2524 (2024)

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Imaging Systems, Microscopy, and Displays

    Received: Jun. 24, 2024

    Accepted: Aug. 11, 2024

    Published Online: Oct. 31, 2024

    The Author Email: Hongwei Chen (chenhw@tsinghua.edu.cn)

    DOI:10.1364/PRJ.533288

    CSTR:32188.14.PRJ.533288

    Topics