Photonics Research, Volume. 13, Issue 10, 2843(2025)

Inter-event interval microscopy for event cameras

Changqing Su1,2,3、†, Yanqin Chen4、†, Zihan Lin5, Zhen Cheng6, You Zhou7, Bo Xiong1,3、*, Zhaofei Yu2,3, and Tiejun Huang3
Author Affiliations
  • 1Institute of Medical Technology, Peking University Health Science Center, Peking University, Beijing 100871, China
  • 2Institute for Artificial Intelligence, Peking University, Beijing 100871, China
  • 3State Key Laboratory for Multimedia Information Processing, Peking University, Beijing 100871, China
  • 4Westlake Laboratory of Life Sciences and Biomedicine, Hangzhou 310024, China
  • 5School of Automation, Hangzhou Dianzi University, Hangzhou 310018, China
  • 6Department of Automation, Tsinghua University, Beijing 100084, China
  • 7Nanjing University Medical School, Nanjing 210023, China
  • show less
    Figures & Tables(13)
    Pipeline of IEIM. (a) The IEIM data collection device. It employs a periodic pulsed modulation of light intensity with a period T. The collected events are processed according to the (b) inter-event interval (IEI) principle, where intervals between events reflect the intensity. (c) IEI calculations are performed on all event streams, and an image is selected from each cycle to represent the intensity at that specific moment.
    Comparison in synthesized static scenes. (a) Qualitative comparison results on normal synthesized data: membrane and mitochondria. (b) Qualitative comparison results on color-reversed synthesized data: actin and nucleus. Our method significantly outperforms SOTA methods.
    Comparison in synthesized motion scenes. Our method significantly outperforms SOTA methods. The red arrow in the GT image points to the area with significant motion. Scale bar, 5 μm.
    Comparison in real-world static scenes. (a) When the power is fixed, the imaging quality varies with the modulation frequency. Excessively high frequencies can lead to a decline in imaging quality, as evident from the zoomed-in details in the second row, indicated by the arrow. (b) When the modulation frequency is fixed, the imaging quality varies with the power. Increasing power can improve imaging quality, but too much power can cause detail loss, as evident from the zoomed-in details in the second row, indicated by the arrow. (c) The reconstruction results of SOTA models on data with a power of 6 mW and a modulation frequency of 500 Hz. The reference image is a region captured by the sCMOS camera that overlaps with the field of view of the event camera. Imaging with IEIM requires appropriate calibration between modulation frequency and light power, and the resulting image quality far exceeds that of SOTA methods. The power in the lower right corner corresponds to the laser power at the output of the objective lens. Scale bar, 2 μm in (a)–(c).
    Comparison in real-world motion scenes. (a) Dynamic imaging results of IEIM at a modulation frequency of 800 Hz and a light power of 9 mW. The second row of images shows detailed views of the white boxed areas in the first row of images, with the dashed lines indicating fixed positions. (b) Reconstruction results of E2VID at a temporal resolution of 1.25 ms. (c) Reconstruction results of E2VID at a temporal resolution of 0.62 ms. (d) Reconstruction results of E2VID at a temporal resolution of 0.31 ms. Our method achieves high-quality imaging with high temporal resolution without the trade-off between temporal resolution and reconstruction detail seen in methods like E2VID. The values in parentheses indicate the temporal resolution of the reconstruction, and the arrow points to the significant difference caused by the variation in reconstruction time resolution. (e) Intensity variation curve along the yellow solid line in (a)–(d). (f) Intensity variation over time at the white dashed line position in (a). Scale bar, 2 μm in (a)–(d).
    Dynamic imaging of common freshwater euglenae. The dynamic processes are presented at three different temporal resolutions, with a minimum of 2 ms, demonstrating that IEIM can effectively image dynamic processes. The images in the second row are magnified views of the regions enclosed by the white boxes in the first row, with dashed lines serving as reference markers to provide a more intuitive visualization of the motion.
    Comparison experiments with and without the modulation device. p.d.: pulsed modulation device. (a)–(c) Results in synthesized data. (d)–(f) Results in real-world data. The reference image is a region captured by the sCMOS camera that overlaps with the field of view of the event camera. Scale bar, 5 μm.
    Comparison of our method and existing network-based methods on synthesized static data with light modulation.
    Comparison of our method and existing network-based methods on real static data with light modulation. Scale bar, 2 μm.
    Comparison of the original network, the retrained network, and our method.
    Comparison of different methods on dynamic imaging of in vivo freshwater euglenae. (a) Reconstruction motion sequences spanning over 60 ms at temporal resolutions of 6 ms, 4 ms, and 2 ms. The arrow points to the fastest-moving part. (b) Intensity variation curve along the yellow solid line in (a). (c) Intensity variation over time at the red dashed line position in (a). Scale bar, 5 μm.
    Comparison of imaging performance between DAVIS346 and Prophesee EVK4 cameras. (a) Event accumulation map from the Prophesee camera over a 30 ms time window. (b) Event map and grayscale image from the DAVIS camera under the same conditions. (c) Event density maps generated by both cameras over a 1 s duration. The lower-left corners of (a) and (b) indicate the image resolution.
    • Table 1. Comparison of Methods on Different Metricsa

      View table
      View in Article

      Table 1. Comparison of Methods on Different Metricsa

      E2VIDE2VID+ET-NetFireNet+IEIM (Ours)
      DataMSESSIMLPIPSMSESSIMLPIPSMSESSIMLPIPSMSESSIMLPIPSMSESSIMLPIPS
      mem(norm_s)0.2240.0720.6070.1530.0590.6890.2360.0500.7480.2470.0530.7790.0010.8880.152
      mit(norm_s)0.1990.1820.5500.1910.1530.6300.1920.1600.6170.2180.1450.6030.0020.8380.139
      act(ivert_s)0.1530.6520.4750.2490.5830.5410.1600.6450.4730.1410.5930.4860.0030.9070.162
      nuc(ivert_s)0.1770.6520.4500.2430.6040.5600.1410.6910.4960.1770.6420.5040.0030.7480.343
      byn(norm_d)0.5140.0370.8110.2450.0350.6530.3230.0480.8370.6540.0370.6650.0070.9150.106
    Tools

    Get Citation

    Copy Citation Text

    Changqing Su, Yanqin Chen, Zihan Lin, Zhen Cheng, You Zhou, Bo Xiong, Zhaofei Yu, Tiejun Huang, "Inter-event interval microscopy for event cameras," Photonics Res. 13, 2843 (2025)

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Imaging Systems, Microscopy, and Displays

    Received: Mar. 19, 2025

    Accepted: Jul. 1, 2025

    Published Online: Sep. 22, 2025

    The Author Email: Bo Xiong (boxiong11@outlook.com)

    DOI:10.1364/PRJ.562782

    CSTR:32188.14.PRJ.562782

    Topics