Advanced Imaging, Volume. 2, Issue 1, 011001(2025)
Privacy-preserving face recognition with a mask-encoded microlens array
Fig. 1. Schematic diagram of the experimental setup. (a) Our MEM-FR prototype for face recognition. (b) Schematic diagram of the convolution calculation correction in the experiment. (c) Concept of the point spread function (PSF) formation. (d) Optical path comparison between our MEM-FR system (right) and LOEN system (left), where the MEM-FR system increases the spatial resolution from
Fig. 2. Impact of the optical convolution kernel size. (a) Recognition accuracy of the MEM-FR system alongside peak signal-to-noise ratio (PSNR) and structural similarity index measure (SSIM) values calculated between the encrypted images and original images, reflecting the privacy protection effectiveness of the system. (b) Principle of the optical standard convolution (top) and dilated convolution (bottom). (c) Privacy protection effectiveness of dilated convolution under different dilation rates.
Fig. 3. Face recognition framework of the MEM-FR system. The network consists of an optical dilated convolution layer and an electronic neural network, with optimized parameters deployed to the physical component for fine-tuning and inference after training.
Fig. 4. Visualization of captured images in the natural scene and experimental setup. Each row represents different poses (including center, left, right, up, and down) from one identity, and each column represents the same pose from different identities.
Fig. 5. Visualization of privacy protection effectiveness and quantitative analysis of image similarity. (a) Original, simulated encrypted, and captured images from the MEM-FR system. (b) Comparative image metrics (PSNR, SSIM, and LPIPS) for captured images between the same and different identities.
Fig. 6. Reconstructed images under a blind deconvolution attack with U-Net. Reconstructed images (training with 200 pairs) have 19.26 dB PSNR and 0.55 SSIM; reconstructed images (training with 600 pairs) have 21.84 dB PSNR and 0.65 SSIM; some key facial features from reconstructed and original images are compared.
|
|
Get Citation
Copy Citation Text
Shukai Wu, Zheng Huang, Caihua Zhang, Conghe Wang, Hongwei Chen, "Privacy-preserving face recognition with a mask-encoded microlens array," Adv. Imaging 2, 011001 (2025)
Category: Research Article
Received: Oct. 23, 2024
Accepted: Dec. 25, 2024
Published Online: Jan. 24, 2025
The Author Email: Chen Hongwei (chenhw@tsinghua.edu.cn)