Journal of Semiconductors, Volume. 45, Issue 9, 090401(2024)
Artificial hawk-eye camera for foveated, tetrachromatic, and dynamic vision
Fig. 1. (Color online) (a) Cross-sectional optical microscope image of the central fovea in a peregrine falcon’s retina. (b) Optical camera image of a cross-sectional view of the artificial fovea. (c) Image simulation results showing the difference in motion in the two regions. Siemens star object is magnified and focused by the artificial fovea in the foveal region. (d) False-colored cross-sectional SEM image of an individual pixel in the multispectral image sensor. (e) Transient photoresponse of an individual pixel under different wavelengths. (f) Colored images obtained from each detector of the multispectral image sensor. The object distance is 200 mm. Scale bars, 2 mm. (g) Reconstructed image by combining color information obtained from each detector of the multispectral image sensor. The inset shows an optical camera image of the object. Scale bar, 2 mm. (h) Optical camera image of 8 pixels by 8 pixels of the multispectral image sensor. Optical microscope images of pixels in the foveal region (red box) and peripheral region (blue box). DF and DP represent the distance between each pixel in the foveal region and peripheral region, respectively. (i) Optical simulation results showing the difference in the image according to the pixel arrangement: foveated density and uniform density. (j) and (k) Simulation results showing object recognition capability of the original image and foveated vision based on YOLO v5. (l) Scatter plot of confidence for foveated vision and original image during 150 frames. (m) and (n) Simulation results showing the motion detection capability of the original image and foveated vision with optic flow based on the Farneback algorithm. The white circle presents the image center, and the arrow depicts visualized motion. (o) Scatter plot of the magnitude of motion within the center of images for the 52nd frame (indicated by white circles in (m) and (n)). Copyright 2024, American Association for the Advancement of Science[5].
Get Citation
Copy Citation Text
Wenhao Ran, Zhuoran Wang, Guozhen Shen. Artificial hawk-eye camera for foveated, tetrachromatic, and dynamic vision[J]. Journal of Semiconductors, 2024, 45(9): 090401
Category: Articles
Received: Jun. 7, 2024
Accepted: --
Published Online: Oct. 11, 2024
The Author Email: Wang Zhuoran (ZRWang), Shen Guozhen (GZShen)