Apart from the improvement in optics, an ultrathin photodiode array with artificial reflectors was constructed mimicking the tapetum lucidum in nocturnal animals, as shown in
Journal of Semiconductors, Volume. 45, Issue 12, 120401(2024)
Artificial cat eye camera for objects detection against complex backgrounds and varied lighting
Figure 1.(Color online) (a) Schematics of feline and conventional vision during the daytime and (b) nighttime. (c) Schematics of the feline vision in the daytime with a VP for light adaptation. The yellow plane represents the tangential plane, and the blue plane represents the sagittal plane. (d) Optical simulation of the cross-sectional focal spot according to object distance. The horizontal cross section represents the tangential plane, and (e) the vertical cross section represents the sagittal plane. (f) Ray tracing simulation for various object distances with small circular pupils and (g) VPs, the cross-shaped object is located at 150, 200, and 250 mm. (h) Simulation for camouflage breaking with small CPs and VPs. The center of the random texture is located at 200 mm, and the background random texture is located at 400 mm. (i) Photograph of the fabricated hemispherical silicon photodetector array combined with patterned silver reflectors (HPA-AgR). The inset shows an individual photodiode pixel with a circuit diagram. (j) Exploded structure of the device with a detailed thickness of each component. (k) Schematic illustration showing the artificial feline eye–inspired vision system. (l) The tested image with the ground truth (GT) image and noisy GT of letters (i.e., F, O, C, U, and S) obtained with a small CP and VP. (m) Optical simulation results for the dataset with small CP and VP for each label. (n) The calculated accuracy rates for the Fashion-MNIST dataset from image simulations, both with and without noise. Copyright 2024, American Association for the Advancement of Science[10].
Apart from the improvement in optics, an ultrathin photodiode array with artificial reflectors was constructed mimicking the tapetum lucidum in nocturnal animals, as shown in
In summary, this artificial vision system shows a high degree of similarity in both structures and functions to cat eyes, demonstrating superior ability in filtering redundant information and detecting camouflaged objects in diverse lighting, overriding the traditional circular pupil structures at the hardware level in this regard. As a result, the cat-eye-inspired bionic system enhances the input image's signal-to-noise ratio on a hardware level by utilizing unique depth-of-field control to disrupt camouflage at specific distances. This sensory hardware implemented image preprocessing can therefore reduce the computational burden of the processor, which would consume extra power on edge detection and feature extraction with conventional sensors in order to perform neural network tasks such as classification or recognition. Consequently, this approach has the potential to save computational resources and reduce power consumption in machine vision. However, it is identified the primary issue lies in the limited pixel density and resolution that is by no means comparable to current CMOS sensors—a persisting challenging araised by the yet-to-be-developed flexible manufacturing technology, in addition to the limited FoV that could potentially be compensated by mechanical eye movement[
Smaller ambush predators usually evolve vertical pupils (VPs), which provide spatial asymmetry of depth of field (DoF) and greater flexibility in controlling focus. This adaptation makes it easier to detect prey that is disguised in their natural environment[
Advanced machine vision provides a direct and fast approach to perceive the external environment, enabling the rapid development in the state-of-art automatic driving, environmental monitoring, and human-machine interaction, etc. However, detecting and recognizing objects from complex backgrounds usually requires high dynamic range imaging and complex algorithms, raising tremedous challenging in further reducing the size, weight, and power (SWaP) in sensory system. Once the target object and background are easily distinguished at the sensor hardware level, a great deal of computational resources and power consumption can be saved[
Get Citation
Copy Citation Text
Shengqiang Zhang, Zhuoran Wang. Artificial cat eye camera for objects detection against complex backgrounds and varied lighting[J]. Journal of Semiconductors, 2024, 45(12): 120401
Category: Research Articles
Received: Sep. 28, 2024
Accepted: --
Published Online: Jan. 15, 2025
The Author Email: Wang Zhuoran (ZRWang)