Photonics Research, Volume. 9, Issue 11, 2277(2021)
Ten-mega-pixel snapshot compressive imaging with a hybrid coded aperture
Fig. 1. Our 10-mega-pixel video SCI system (a) and the schematic (b). Ten high-speed (200 fps) high-resolution (
Fig. 2. Pipeline of the proposed large-scale HCA-SCI system (left) and the PnP reconstruction algorithms (right). Left: During the encoded photography stage, a dynamic low-resolution mask at the aperture plane and a static high-resolution mask close to the sensor plane work together to generate a sequence of high-resolution codes to encode the large-scale video into a snapshot. Right: In the decoding, the video is reconstructed under a PnP framework incorporating deep denoising prior and TV prior into a convex optimization (GAP), which leverages the good convergence of GAP and the high efficiency of the deep network.
Fig. 3. Illustration of the multiplexed mask generation. For the same scene point, its images generated by different sub-apertures (marked as blue, yellow, and red, respectively) intersect the mask plane with different regions and are thus encoded with corresponding (shifted) random masks before summation at the sensor. The multiplexing would raise the light flux for high SNR recording, while doing so only with slight performance degeneration.
Fig. 4. Multiplexing pattern schemes used in our experiments (taking
Fig. 5. Reconstruction results and comparison with state-of-the-art algorithms on simulated data at different resolutions (left:
Fig. 6. Noise robustness comparison between multiplexed and non-multiplexed masks.
Fig. 7. Reconstruction results of the PnP–TV–FastDVDNet on real data captured by our HCA-SCI system (
Fig. 8. Reconstruction comparison between the GAP–TV, PnP–FFDNet, and PnP–TV–FastDVDNet on real data captured by our HCA-SCI system (
|
|
|
Get Citation
Copy Citation Text
Zhihong Zhang, Chao Deng, Yang Liu, Xin Yuan, Jinli Suo, Qionghai Dai. Ten-mega-pixel snapshot compressive imaging with a hybrid coded aperture[J]. Photonics Research, 2021, 9(11): 2277
Category: Imaging Systems, Microscopy, and Displays
Received: Jul. 8, 2021
Accepted: Aug. 12, 2021
Published Online: Oct. 25, 2021
The Author Email: Jinli Suo (jlsuo@tsinghua.edu.cn)