Researching | High-speed video imaging via multiplexed temporal gradient snapshot

Advanced Photonics Nexus, Volume. 4, Issue 4, 046017(2025)

High-speed video imaging via multiplexed temporal gradient snapshot Editors' Pick

Yifei Zhang¹, Xing Liu², Lishun Wang², Ping Wang², Ganzhangqin Yuan¹, Mu Ku Chen³, Kui Jiang⁴, Xin Yuan^2、*, and Zihan Geng^1,5、*

Author Affiliations

¹Tsinghua University, Tsinghua Shenzhen International Graduate School, Shenzhen, China

²Westlake University, Research Center for Industries of the Future and School of Engineering, Hangzhou, China

³City University of Hong Kong, Department of Electrical Engineering, Hong Kong, China

⁴Harbin Institute of Technology, School of Computer Science and Technology, Harbin, China

⁵Pengcheng Laboratory, Shenzhen, China

show less

Full Text Get PDF

Figures&Tables (18)

References (55)

Paper Information

References(55)

[1] High-speed imaging of drops and bubbles. Annu. Rev. Fluid Mech., 40, 257-285(2008). https://doi.org/10.1146/annurev.fluid.40.111406.102215

[2] High-speed imaging in fluids. Exp. Fluids, 54, 1458(2013). https://doi.org/10.1007/s00348-013-1458-x

[3] et alTrackNet: a deep learning network for tracking high-speed and tiny objects in sports applications, 1-8(2019). https://doi.org/10.1109/AVSS.2019.8909871

[4] et alHigh-speed videography using a dense camera array, II-II(2004). https://doi.org/10.1109/CVPR.2004.1315176

[5] et alSwept coded aperture real-time femtophotography. Nat. Commun., 15, 1589(2024). https://doi.org/10.1038/s41467-024-45820-z

[6] et alPlug-and-play algorithms for video snapshot compressive imaging. IEEE Trans. Pattern Anal. Mach. Intell., 44, 7093-7111(2021). https://doi.org/10.1109/TPAMI.2021.3099035

[7] Snapshot compressive imaging: theory, algorithms, and applications. IEEE Signal Process. Mag., 38, 65-88(2021). https://doi.org/10.1109/MSP.2020.3023869

[8] et alSnapshot difference imaging using correlation time-of-flight sensors. ACM Trans. Graph., 36, a220(2017). https://doi.org/10.1145/3130800.3130885

[9] et alCoded two-bucket cameras for computer vision. Lect. Notes Comput. Sci., 11207, 54-71(2018). https://doi.org/10.1007/978-3-030-01219-9_4

[10] et alLow-cost compressive sensing for color video and depth, 3318-3325(2014). https://doi.org/10.1109/CVPR.2014.424

[11] et alNeural sensors: learning pixel exposures for HDR imaging and video compressive sensing with programmable sensors. IEEE Trans. Pattern Anal. Mach. Intell., 42, 1642-1653(2020). https://doi.org/10.1109/TPAMI.2020.2986944

[12] et alSingle-shot compressed ultrafast photography: a review. Adv. Photonics, 2, 014003(2020). https://doi.org/10.1117/1.AP.2.1.014003

[13] et alCoded aperture compressive temporal imaging. Opt. Express, 21, 10526-10545(2013). https://doi.org/10.1364/OE.21.010526

[14] et alVideo from stills: lensless imaging with rolling shutter, 1-8(2019). https://doi.org/10.1109/ICCPHOT.2019.8747341

[15] Single-shot ultrafast imaging attaining 70 trillion frames per second. Nat. Commun., 11, 2091(2020). https://doi.org/10.1038/s41467-020-15745-4

[16] et alA unified framework for compressive video recovery from coded exposure techniques, 1600-1609(2021). https://doi.org/10.1109/WACV48630.2021.00164

[17] et alAdaptive nonlocal sparse representation for dual-camera compressive hyperspectral imaging. IEEE Trans. Pattern Anal. Mach. Intell., 39, 2104-2111(2016). https://doi.org/10.1109/TPAMI.2016.2621050

[18] et alFlutter shutter video camera for compressive sensing of videos, 1-9(2012). https://doi.org/10.1109/ICCPhot.2012.6215211

[19] Coded exposure photography: motion deblurring using fluttered shutter, 795-804(2006). https://doi.org/10.1145/1141911.1141957

[20] et alCoded rolling shutter photography: flexible space-time sampling, 1-8(2010). https://doi.org/10.1109/ICCPHOT.2010.5585094

[21] et alDeep coded exposure: end-to-end co-optimization of flutter shutter and deblurring processing for general motion blur removal. Photonics Res., 11, 1678-1686(2023). https://doi.org/10.1364/PRJ.489989

[22] et alRetrieving object motions from coded shutter snapshot in dark environment. IEEE Trans. Image Process., 32, 3281-3294(2023). https://doi.org/10.1109/TIP.2023.3280010

[23] et alLearning from temporal gradient for semi-supervised action recognition, 3252-3262(2022). https://doi.org/10.1109/CVPR52688.2022.00325

[24] Ista-Net: interpretable optimization-inspired deep network for image compressive sensing, 1828-1837(2018). https://doi.org/10.1109/CVPR.2018.00196

[25] et alPlug-and-play methods for integrating physical and learned models in computational imaging: theory, algorithms, and applications. IEEE Signal Process. Mag., 40, 85-97(2023). https://doi.org/10.1109/MSP.2022.3199595

[26] et alPlug-and-play image restoration with deep denoiser prior. IEEE Trans. Pattern Anal. Mach. Intell., 44, 6360-6376(2021). https://doi.org/10.1109/TPAMI.2021.3088914

[27] et alCBAM: convolutional block attention module. Lect. Notes Comput. Sci., 11211, 3-19(2018). https://doi.org/10.1007/978-3-030-01234-2_1

[28] et alComputational super-resolution imaging with a sparse rotational camera array. IEEE Trans. Comput. Imaging, 9, 425-434(2023). https://doi.org/10.1109/TCI.2023.3265919

[29] et alFocal network for image restoration, 13001-13011(2023). https://doi.org/10.1109/ICCV51070.2023.01195

[30] et alInception-v4, inception-resnet and the impact of residual connections on learning(2017). https://doi.org/10.1609/aaai.v31i1.11231

[31] et alHighlight-aware two-stream network for single-image svbrdf acquisition. ACM Trans. Graph., 40, 1-14(2021). https://doi.org/10.1145/3450626.3459854

[32] Is space-time attention all you need for video understanding?, 4(2021).

[33] EfficientSci: densely connected network with space-time factorization for large-scale video snapshot compressive imaging, 18477-18486(2023). https://doi.org/10.1109/CVPR52729.2023.01772

[34] et alDeepLab: semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected CRFs. IEEE Trans. Pattern Anal. Mach. Intell., 40, 834-848(2017). https://doi.org/10.1109/TPAMI.2017.2699184

[35] et alRecurrent neural networks for snapshot compressive imaging. IEEE Trans. Pattern Anal. Mach. Intell., 45, 2264-2281(2022). https://doi.org/10.1109/TPAMI.2022.3161934

[36] et alThe 2017 Davis challenge on video object segmentation(2017).

[37] et alDeep video deblurring for hand-held cameras, 1279-1288(2017). https://doi.org/10.1109/CVPR.2017.33

[38] Deep multi-scale convolutional neural network for dynamic scene deblurring, 257-265(2017). https://doi.org/10.1109/CVPR.2017.35

[39] et alSuper SLOMO: high quality estimation of multiple intermediate frames for video interpolation, 9000-9008(2018). https://doi.org/10.1109/CVPR.2018.00938

[40] et alA unified pyramid recurrent network for video frame interpolation, 1578-1587(2023). https://doi.org/10.1109/CVPR52729.2023.00158

[41] et alIFRNet: intermediate feature refine network for efficient frame interpolation, 1969-1978(2022). https://doi.org/10.1109/CVPR52688.2022.00201

[42] et alGeneralizable implicit motion modeling for video frame interpolation, 63747-63770(2024). https://dl.acm.org/doi/10.5555/3737916.3739952

[43] et alTime lens: event-based video frame interpolation, 16155-16164(2021). https://doi.org/10.1109/CVPR46437.2021.01589

[44] et alTimereplayer: unlocking the potential of event cameras for video interpolation, 17804-17813(2022). https://doi.org/10.1109/CVPR52688.2022.01728

[45] et alVideo interpolation by event-driven anisotropic adjustment of optical flow. Lect. Notes Comput. Sci., 13667, 267-283(2022). https://doi.org/10.1007/978-3-031-20071-7_16

[46] et alRestormer: efficient transformer for high-resolution image restoration, 5728-5739(2022). https://doi.org/10.1109/CVPR52688.2022.00564

[47] et alStripFormer: strip transformer for fast image deblurring. Lect. Notes Comput. Sci., 13679, 146-162(2022). https://doi.org/10.1007/978-3-031-19800-7_9

[48] et alEvent-based fusion for motion deblurring with cross-modal attention. Lect. Notes Comput. Sci., 13678, 412-428(2022). https://doi.org/10.1007/978-3-031-19797-0_24

[49] et alEvent-based frame interpolation with ad-hoc deblurring, 18043-18052(2023). https://doi.org/10.1109/CVPR52729.2023.01730

[50] et alMulti-stage progressive image restoration, 14821-14831(2021). https://doi.org/10.1109/CVPR46437.2021.01458

[51] et alSimple baselines for image restoration. Lect. Notes Comput. Sci., 13667, 17-33(2022). https://doi.org/10.1007/978-3-031-20071-7_2

[52] Deep optics for video snapshot compressive imaging, 10646-10656(2023). https://doi.org/10.1109/ICCV51070.2023.00977

[53] et alSpatial-temporal transformer for video snapshot compressive imaging. IEEE Trans. Pattern Anal. Mach. Intell., 45, 9072-9089(2022). https://doi.org/10.1109/TPAMI.2022.3225382

[54] et alLightweight high-speed photography built on coded exposure and implicit neural representation of videos. Int. J. Comput. Vision, 133, 991-1011(2025). https://doi.org/10.1007/s11263-024-02198-1

[55] et alUnprocessing images for learned raw denoising, 11036-11045(2019). https://doi.org/10.1109/CVPR.2019.01129

Tools

Get Citation

Copy Citation Text

Yifei Zhang, Xing Liu, Lishun Wang, Ping Wang, Ganzhangqin Yuan, Mu Ku Chen, Kui Jiang, Xin Yuan, Zihan Geng, "High-speed video imaging via multiplexed temporal gradient snapshot," Adv. Photon. Nexus 4, 046017 (2025)

Download Citation

EndNote(RIS)BibTex Plain Text

Set citation alerts for article

Save article for my favorites

Paper Information

Category: Research Articles

Received: Mar. 26, 2025

Accepted: Jul. 4, 2025

Published Online: Aug. 15, 2025

The Author Email: Xin Yuan (xyuan@westlake.edu.cn), Zihan Geng (geng.zihan@sz.tsinghua.edu.cn)

DOI:10.1117/1.APN.4.4.046017

CSTR:32397.14.1.APN.4.4.046017

Topics

laser devices and laser physics

Lasers and Laser Optics

laser manufacturing

Instrumentation, Measurement and Metrology