Acta Optica Sinica, Volume. 43, Issue 23, 2300001(2023)

Research Progress of Vergence-Accommodation Conflict in Near-Eye Display Based on Augmented Reality

Shulong Wang1, Zijian Lin2, Shixiang Xu1、*, Yu Wang3, Kun Yang3, Yidan Huang2, and Enguo Chen2、**
Author Affiliations
  • 1College of Physics and Optoelectronic Engineering, Shenzhen University, Shenzhen 518060, Guangdong , China
  • 2National and Local United Engineering Laboratory of Flat Panel Display Technology, College of Physics and Information Engineering, Fuzhou University, Fuzhou 350108, Fujian , China
  • 3Nanyang Lida Optic-electronics Co., Ltd., Nanyang 473003, Henan , China
  • show less

    Significance

    As the entrance technology of metaverse, augmented reality (AR) is highly likely to become the next generation computing platform. Near-eye display is the core foundation for the development and application of AR technology and is the direct medium for people to receive virtual information and combine reality. Near-eye display optical systems are the core component of AR, and the maturity of the display module is part of AR technology popularization. The vergence-accommodation conflict (VAC) of near-eye display systems is a key challenge restricting the large-scale AR application.

    Human beings obtain 80% of external information by human eye vision. To obtain the 3D display effect, near-eye display optical systems will simulate the real scenes through both eyes, displaying the independent pictures of the two eyes with certain parallax to make the brain perceive the 3D display effect. Meanwhile, the eye lens is always focused on the virtual image plane of the micro-display of the optical system, which indicates the fixed eye accommodation distance. Due to the setting of the left and right eye images with parallax, the brain will perceive the distance of the 3D image objects, and then the convergence distance of human eyes will change with the built-in image source. As a result, a mismatch is caused between the convergence distance and the accommodation distance, which is a VAC problem. When the user is in this state for a long time, visual fatigue, dizziness, and vomiting will occur. The VAC problem in the near-eye display optical system causes the display scene to deviate from people's perception in the real world, which brings bad user experience and is a major challenge to be solved for the long-term utilization and popularization of AR devices.

    Progress

    VAC is an insurmountable technical challenge in the development of AR display technology. We classify its solutions to provide references for selecting solutions suitable for different technical development needs, and review current VAC solutions, classifying them as solutions without depth information, with partial depth information, and with complete depth information (Fig. 2). In the VAC solutions without depth information, we mainly introduce Maxwellian display technology, which takes the image as a single point beam through the eye lens photocentric position and subsequently images it directly onto the retina. Thus, the limitation that the eye lens must be forced to focus can be addressed, which means the human eye lens can observe the image in different diopter states and the VAC problem can be overcome. Lin et al. implemented a MEMS-based Maxwellian display system to achieve a 33°×22° display field of view with an exit pupil distance of 10 mm, converging the imaging beam into a 5 μm spot with the best imaging quality when the spot is at the photocentric position of the human eyes. The Maxwellian technique requires the converging light to form a beam point that matches the pupil position, resulting in the natural limitation and drawback of this solution in the exit pupil range and needs to be matched with a corresponding pupil extension technique.

    In the VAC solutions with partial depth information, we mainly introduce multi-focal plane display technology (physical multi-focal plane and virtual multi-focal plane) and adjustable focus display technology. Cheng et al. equipped two microdisplays to implement a two-focal plane AR near-eye display module by spatial multiplexing [Fig. 6(c)]. The display solution achieves a 40° display field of view, an exit pupil distance of 20 mm, and an eyebox aperture of 6 mm, enabling two different focal planes at 1.25 m and 5 m distances.

    In the VAC solutions with complete depth information, we introduce integrated imaging and computational holography solution. Hua et al. employed an integrated imaging unit as a stereo microdisplay image source combined with a free-form prism to form an AR near-eye display module with depth information, achieving a 33.4° display field of view, an exit pupil distance of 19 mm, and an eyebox aperture of 6.5 mm [Fig. 9(a)]. Zhang et al. achieved complex amplitude wavefront reconstruction of image information by cascading amplitude holograms to provide complete depth information for AR near-eye display. Finally, the undesirable effects of VAC are eliminated to achieve a 4.8° display field of view (9.4× secondary magnification) with an exit pupil distance of 10 mm.

    Conclusions and Prospects

    We present a systematic review of VAC solutions in AR near-eye display optical systems. Meanwhile, the focus is on the basic principles of the VAC problem and the technical features, implementation methods, and representative literature of current near-eye display optical solutions.

    The VAC problem is contrary to the physiological characteristics of human eyes in daily observation and is an inevitable difficulty for AR to enhance viewing comfort. In current VAC solutions, Maxwellian near-eye display, variable focus, and multi-focal plane near-eye display solutions have relative advantages in design and image quality.

    Tools

    Get Citation

    Copy Citation Text

    Shulong Wang, Zijian Lin, Shixiang Xu, Yu Wang, Kun Yang, Yidan Huang, Enguo Chen. Research Progress of Vergence-Accommodation Conflict in Near-Eye Display Based on Augmented Reality[J]. Acta Optica Sinica, 2023, 43(23): 2300001

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Reviews

    Received: May. 31, 2023

    Accepted: Aug. 2, 2023

    Published Online: Dec. 12, 2023

    The Author Email: Xu Shixiang (shxxu@szu.edu.cn), Chen Enguo (ceg@fzu.edu.cn)

    DOI:10.3788/AOS231074

    Topics