Advanced Photonics, Volume. 6, Issue 2, 024001(2024)
Review of bio-inspired image sensors for efficient machine vision
Fig. 1. Comparison between bio-inspired and traditional image sensors.
Fig. 3. Bio-inspired image sensors for efficient machine vision. Adapted with permission from Refs. 2325" target="_self" style="display: inline;">–
Fig. 4. Bio-inspired sensory architectures. (a) The overview of processing near-sensor architecture system without ADC. Reproduced with permission from Ref. 31. (b) CIM near-sensor architecture. Reproduced with permission from Ref. 32. (c) Schematic of IGZO phototransistor array to realize in-sensor compression simulation. Reproduced with permission from Ref. 33. (d) Optical enhancement and electrical suppression of IGZO phototransistors. Reproduced with permission from Ref. 33. (e) The recognition accuracy of MNIST images reconstructed with different sampling rates. Reproduced with permission from Ref. 33. (f) 2D retinomorphic device structure and motion detection of trichromatic trolleys. Reproduced with permission from Ref. 34.
Fig. 5. Novel sensory devices based on sparse coding. (a) Light stimulus-induced spike trains. Reproduced with permission from Ref. 49. (b) Image recognition using photosensor-multivibrator circuit and photonic synapse. Reproduced with permission from Ref. 49. (c) Spike-number-dependent amplitude variation of excitatory postsynaptic current (ΔEPSC) triggered by a train of optical spikes. Reproduced with permission from Ref. 49. (d) Schematic of a multifunctional memristor array stimulated by various electrical and optical inputs. Reproduced with permission from Ref. 50. (e) Read-current responses of a memristor by several optical input signals. Reproduced with permission from Ref. 50. (f) The operation of optoelectronic RC based on 2D SnS memristors for classifying consonants and vowels in the Korean alphabet. Reproduced with permission from Ref. 50.
Fig. 6. Neural adaptation sensors for visual compression. (a) Event-driven sampling and frame-based sampling. Reproduced with permission from Ref. 51. (b) CSDVS pixel circuit. Reproduced with permission from Ref. 52. (c) Comparison of simulated normal DVS and CSDVS response to a flashing spot. Reproduced with permission from Ref. 52. (d) Illustration of a machine vision system based on the
Fig. 7. Basic principles of layer-by-layer processing sensors. (a) Conventional computing architectures. (b) Near-sensor computing architecture. (c) In-sensor computing architecture. Reproduced with permission from Ref. 63.
Fig. 8. Basic principles of sparse coding sensors. (a) Conventional linear response image sensing principle. (b) Image sensing and sparse coding principle.
Fig. 9. Basic principles of neural adaptation sensors. Reproduced with permission from Ref. 25.
|
Get Citation
Copy Citation Text
Wenhao Tang, Qing Yang, Hang Xu, Yiyu Guo, Jiqiang Zhang, Chunfang Ouyang, Leixin Meng, Xu Liu, "Review of bio-inspired image sensors for efficient machine vision," Adv. Photon. 6, 024001 (2024)
Category: Reviews
Received: Nov. 13, 2023
Accepted: Mar. 14, 2024
Posted: Mar. 14, 2024
Published Online: Apr. 25, 2024
The Author Email: Meng Leixin (menglx@zhejianglab.com), Liu Xu (liuxu@zju.edu.cn)