Journal of Semiconductors, Volume. 45, Issue 9, 090401(2024)

Artificial hawk-eye camera for foveated, tetrachromatic, and dynamic vision

Wenhao Ran1,2, Zhuoran Wang1,2、*, and Guozhen Shen1,2、**
Author Affiliations
  • 1School of Integrated Circuits and Electronics, Beijing Institute of Technology, Beijing 100081, China
  • 2Institute of Flexible Electronics, Beijing Institute of Technology, Beijing 102488, China
  • show less
    Figures & Tables(1)
    (Color online) (a) Cross-sectional optical microscope image of the central fovea in a peregrine falcon’s retina. (b) Optical camera image of a cross-sectional view of the artificial fovea. (c) Image simulation results showing the difference in motion in the two regions. Siemens star object is magnified and focused by the artificial fovea in the foveal region. (d) False-colored cross-sectional SEM image of an individual pixel in the multispectral image sensor. (e) Transient photoresponse of an individual pixel under different wavelengths. (f) Colored images obtained from each detector of the multispectral image sensor. The object distance is 200 mm. Scale bars, 2 mm. (g) Reconstructed image by combining color information obtained from each detector of the multispectral image sensor. The inset shows an optical camera image of the object. Scale bar, 2 mm. (h) Optical camera image of 8 pixels by 8 pixels of the multispectral image sensor. Optical microscope images of pixels in the foveal region (red box) and peripheral region (blue box). DF and DP represent the distance between each pixel in the foveal region and peripheral region, respectively. (i) Optical simulation results showing the difference in the image according to the pixel arrangement: foveated density and uniform density. (j) and (k) Simulation results showing object recognition capability of the original image and foveated vision based on YOLO v5. (l) Scatter plot of confidence for foveated vision and original image during 150 frames. (m) and (n) Simulation results showing the motion detection capability of the original image and foveated vision with optic flow based on the Farneback algorithm. The white circle presents the image center, and the arrow depicts visualized motion. (o) Scatter plot of the magnitude of motion within the center of images for the 52nd frame (indicated by white circles in (m) and (n)). Copyright 2024, American Association for the Advancement of Science[5].
    Tools

    Get Citation

    Copy Citation Text

    Wenhao Ran, Zhuoran Wang, Guozhen Shen. Artificial hawk-eye camera for foveated, tetrachromatic, and dynamic vision[J]. Journal of Semiconductors, 2024, 45(9): 090401

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Articles

    Received: Jun. 7, 2024

    Accepted: --

    Published Online: Oct. 11, 2024

    The Author Email: Wang Zhuoran (ZRWang), Shen Guozhen (GZShen)

    DOI:10.1088/1674-4926/24060010

    Topics