Laser & Optoelectronics Progress, Volume. 60, Issue 8, 0811008(2023)

Status and Prospect of Augmented Reality Head-Up Display

Ting Zhou1、†, Wen Qiao†、*, Jianyu Hua, and Linsen Chen
Author Affiliations
  • School of Optoelectronic Science and Engineering, Soochow University, Suzhou 215006, Jiangsu, China
  • show less
    References(91)

    [1] Klauer S, Dingus T, Neale V et al[M]. The impact of driver inattention on near-crash/crash risk: an analysis using the 100-car naturalistic driving study data(2006).

    [2] Fu X L. Application of head-up display technology in automobile industry[J]. Technology Wind, 5-12(2020).

    [3] Liu Y C, Wen M H. Comparison of head-up display (HUD) vs. head-down display (HDD): driving performance of commercial vehicle operators in Taiwan[J]. International Journal of Human-Computer Studies, 61, 679-697(2004).

    [4] Alejandro B J, Gilberto O G, David A J. Advances and trends of head-up and head-down display systems in automobiles[J]. Proceedings of SPIE, 9086, 90860E(2014).

    [5] Gish K W, Staplin L. Human factors aspects of using head up displays in automobiles: a review of the literature, interim report[R](1995).

    [6] Smith S, Fu S H. The relationships between automobile head-up display presentation images and drivers’ Kansei[J]. Displays, 32, 58-68(2011).

    [7] Ablassmeier M, Poitschke T, Wallhoff F et al. Eye gaze studies comparing head-up and head-down displays in vehicles[C], 2250-2252(2007).

    [9] Fadden S, Wickens C, Ververs P. Costs and benefits of head up displays-an attention perspective and a meta analysis[C], 5542(2000).

    [10] Horrey W J, Wickens C D, Alexander A L. The effects of head-up display clutter and In-vehicle display separation on concurrent driving performance[J]. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 47, 1880-1884(2003).

    [12] Skirnewskaja J, Wilkinson T D. Automotive holographic head-up displays[J]. Advanced Materials, 34, e2110463(2022).

    [13] Cai J H. Research on the technology of diffraction used in head-up display service[D](2013).

    [14] Chen X W, Cao Y, X J L et al. Optimal design of optical module of the head-up display system with two free-form surfaces[J]. Laser & Optoelectronics Progress, 60, 0922001(2023).

    [15] Blankenbach K. Requirements and system aspects of AR-head-up displays[J]. IEEE Consumer Electronics Magazine, 8, 62-67(2019).

    [16] Sulyok Á, Erdei G, Koppa P. Flat panel head-up display with motion parallax[C], Th2A.11(2022).

    [17] Ou G H. Research and design of augmented reality head-up display optical system for vehicles[D](2019).

    [18] Cao Y. Optimized design of optical module for automotive head-up display system[D](2022).

    [19] Singh I, Kumar A, Singh H S et al. Optical design and performance evaluation of a dual-beam combiner head-up display[J]. Optical Engineering, 35, 813-818(1996).

    [20] Park H S, Park M W, Won K H et al. In-vehicle AR-HUD system to provide driving-safety information[J]. ETRI Journal, 35, 1038-1047(2013).

    [21] Qin Z, Lin F C, Huang Y P et al. Maximal acceptable ghost images for designing a legible windshield-type vehicle head-up display[J]. IEEE Photonics Journal, 9(2017).

    [25] Gabbard J L, Fitch G M, Kim H. Behind the glass: driver challenges and opportunities for AR automotive applications[J]. Proceedings of the IEEE, 102, 124-136(2014).

    [26] Tufano D R. Automotive HUDs: the overlooked safety issues[J]. Human Factors, 39, 303-311(1997).

    [27] Ng-Thow-Hing V, Bark K, Beckwith L et al. User-centered perspectives for automotive augmented reality[C], 13-22(2013).

    [28] Ward N J, Parkes A. Head-up displays and their automotive application: an overview of human factors issues affecting safety[J]. Accident Analysis & Prevention, 26, 703-717(1994).

    [29] Kim B H, Park S C. Optical system design for a head-up display using aberration analysis of an off-axis two-mirror system[J]. Journal of the Optical Society of Korea, 20, 481-487(2016).

    [30] Kim K H, Park S C. Design of confocal off-axis two-mirror system for head-up display[J]. Applied Optics, 58, 677-683(2019).

    [31] Wei S L, Fan Z C, Zhu Z B et al. Design of a head-up display based on freeform reflective systems for automotive applications[J]. Applied Optics, 58, 1675-1681(2019).

    [32] Gu L, Cheng D W, Liu Y et al. Design and fabrication of an off-axis four-mirror system for head-up displays[J]. Applied Optics, 59, 4893-4900(2020).

    [33] Okumura H, Hotta A, Sasaki T et al. Wide field of view optical combiner for augmented reality head-up displays[C](2018).

    [34] An Z, Meng X P, Ji X et al. Notice of violation of IEEE publication principles: design and performance of an off-axis free-form mirror for a rear mounted augmented-reality head-up display system[J]. IEEE Photonics Journal, 13, 7000215(2021).

    [35] Hirokawa T, Yachida T. Head up display device[P].

    [36] Morohashi K, Sato M, Takahashi Y et al. Projection device and head-up display device[P].

    [39] Fan C, He S Y. Micromirror based virtual image automotive head-up display[J]. Microsystem Technologies, 23, 1671-1676(2017).

    [40] Mullins B, Greenhalgh P, Christmas J. 59-5: Invited paper: the holographic future of head up displays[J]. SID Symposium Digest of Technical Papers, 48, 886-889(2017).

    [41] Christmas J, Collings N. 75-2: Invited paper: realizing automotive holographic head up displays[J]. SID Symposium Digest of Technical Papers, 47, 1017-1020(2016).

    [43] Wang W, Zhu X L, Chan K et al. Digital holographic system for automotive augmented reality head-up-display[C], 1327-1330(2018).

    [44] Chakir S, Mermillod P, Heggarty K et al. Wide field of view re-configurable foveal projection systems using a phase only spatial light modulator: an application to a new generation of automotive HUDs[J]. Optics Express, 30, 12937-12951(2022).

    [45] Hedili M K, Freeman M O, Urey H. Microlens array-based high-gain screen design for direct projection head-up displays[J]. Applied Optics, 52, 1351-1357(2013).

    [46] Gu L, Cheng D W, Wang Q W et al. Design of a two-dimensional stray-light-free geometrical waveguide head-up display[J]. Applied Optics, 57, 9246-9256(2018).

    [47] Li Y L, Chen J J, Sun X H et al. Design of vehicle-mounted head-up display system based on microprism array optical waveguide[J]. Laser & Optoelectronics Progress, 59, 1722004(2022).

    [48] Richter P, von Spiegel W, Waldern J. 55-2: Invited paper: volume optimized and mirror-less holographic waveguide augmented reality head-up display[J]. SID Symposium Digest of Technical Papers, 49, 725-728(2018).

    [50] Draper C T, Bigler C M, Mann M S et al. Holographic waveguide head-up display with 2-D pupil expansion and longitudinal image magnification[J]. Applied Optics, 58, A251-A257(2019).

    [51] Bigler C M, Blanche P A, Sarma K. Holographic waveguide heads-up display for longitudinal image magnification and pupil expansion[J]. Applied Optics, 57, 2007-2013(2018).

    [52] Bang K, Jang C, Lee B. Curved holographic optical elements and applications for curved see-through displays[J]. Journal of Information Display, 20, 9-23(2019).

    [53] Draper C T, Blanche P A. Holographic curved waveguide combiner for HUD/AR with 1-D pupil expansion[J]. Optics Express, 30, 2503-2516(2022).

    [54] Lü Z L, Liu J, Yang Y. Dual-view and multi-content head-up display using a single picture generation unit and two-layer volume holographic grating[J]. IEEE Photonics Journal, 14, 7035208(2022).

    [55] Malcolm H. The use of optical waveguides in head up display (HUD) applications[J]. Proceedings of SPIE, 8736, 87360E(2013).

    [56] Chou T A, Pan T H, Chuang C H et al. P-145: Student poster: AR HUD system realized by holographic display technology[J]. SID Symposium Digest of Technical Papers, 53, 1185-1187(2022).

    [57] Basak U Y, Kazempourradi S M K, Ulusoy E et al. Wide field-of-view dual-focal-plane augmented reality display[J]. Proceedings of SPIE, 10942, 1094209(2019).

    [58] Li S Q, Xu X W, Maruthiyodan Veetil R et al. Phase-only transmissive spatial light modulator based on tunable dielectric metasurface[J]. Science, 364, 1087-1090(2019).

    [59] Skirnewskaja J, Montelongo Y, Wilkes P et al. LiDAR-derived digital holograms for automotive head-up displays[J]. Optics Express, 29, 13681-13695(2021).

    [61] Shi B C, Hong T, Wei W et al. 34.3: a dual depth head up display system for vehicle[J]. SID Symposium Digest of Technical Papers, 49, 371-374(2018).

    [62] Qin Z, Lin S M, Luo K T et al. Dual-focal-plane augmented reality head-up display using a single picture generation unit and a single freeform mirror[J]. Applied Optics, 58, 5366-5374(2019).

    [63] Seo J H, Yoon C Y, Oh J H et al. 59-4: a study on multi-depth head-up display[J]. SID Symposium Digest of Technical Papers, 48, 883-885(2017).

    [64] Nakagawa J, Yamaguchi H, Yasuda T. Head up display with laser scanning unit[J]. Proceedings of SPIE, 11125, 111250C(2019).

    [65] Wang Y J, Lin Y H. An optical system for augmented reality with electrically tunable optical zoom function and image registration exploiting liquid crystal lenses[J]. Optics Express, 27, 21163-21172(2019).

    [66] Zou J Y, Hsiang E L, Zhan T et al. High dynamic range head-up displays[J]. Optics Express, 28, 24298-24307(2020).

    [67] Li L, Wang Q H, Jiang W. Liquid lens with double tunable surfaces for large power tunability and improved optical performance[J]. Journal of Optics, 13, 115503(2011).

    [68] Li K, Geng Y, Yöntem A Ö et al. Head-up display with dynamic depth-variable viewing effect[J]. Optik, 221, 165319(2020).

    [69] Zhan T, Lee Y H, Tan G J et al. Pancharatnam–Berry optical elements for head-up and near-eye displays[J]. Josa B, 36, D52-D65(2019).

    [70] Zhan T, Lee Y H, Xiong J H et al. High-efficiency switchable optical elements for advanced head-up displays[J]. Journal of the Society for Information Display, 27, 223-231(2019).

    [71] Mu C T, Lin W T, Chen C H. Zoomable head-up display with the integration of holographic and geometrical imaging[J]. Optics Express, 28, 35716-35723(2020).

    [72] Coni P, Bardon J L, Damamme N et al. 56-1: a multiplane holographic HUD using light selectivity of Bragg grating[J]. SID Symposium Digest of Technical Papers, 50, 775-778(2019).

    [73] Lü Z L, Xu Y, Yang Y et al. Multiplane holographic augmented reality head-up display with a real-virtual dual mode and large eyebox[J]. Applied Optics, 61, 9962-9971(2022).

    [74] Lü Z L, Liu J, Xu L F. A multi-plane augmented reality head-up display system based on volume holographic optical elements with large area[J]. IEEE Photonics Journal, 13, 5200108(2021).

    [75] Zhou F B, Zhou F, Chen Y et al. Vector light field display based on an intertwined flat lens with large depth of focus[J]. Optica, 9, 288-294(2022).

    [76] Shi J C, Hua J Y, Zhou F B et al. Augmented reality vector light field display with large viewing distance based on pixelated multilevel blazed gratings[J]. Photonics, 8, 337(2021).

    [77] Hua J Y, Hua E K, Zhou F B et al. Foveated glasses-free 3D display with ultrawide field of view via a large-scale 2D-metagrating complex[J]. Light: Science & Applications, 10, 1-9(2021).

    [78] Hahn J, Kim H, Lim Y et al. Wide viewing angle dynamic holographic stereogram with a curved array of spatial light modulators[J]. Optics Express, 16, 12372-12386(2008).

    [79] Ting C H, Chang Y C, Chen C H et al. Multi-user 3D film on a time-multiplexed side-emission backlight system[J]. Applied Optics, 55, 7922-7928(2016).

    [80] Fattal D, Peng Z, Tran T et al. A multi-directional backlight for a wide-angle, glasses-free three-dimensional display[J]. Nature, 495, 348-351(2013).

    [81] Li J C, Tu H Y, Yeh W C et al. Holographic three-dimensional display and hologram calculation based on liquid crystal on silicon device[invited[J]. Applied Optics, 53, G222-G231(2014).

    [82] Fan Z C, Weng Y T, Chen G W et al. 3D interactive surgical visualization system using mobile spatial information acquisition and autostereoscopic display[J]. Journal of Biomedical Informatics, 71, 154-164(2017).

    [83] Geng J. Three-dimensional display technologies[J]. Advances in Optics and Photonics, 5, 456-535(2013).

    [84] Son J Y, Javidi B. Three-dimensional imaging methods based on multiview images[J]. Journal of Display Technology, 1, 125-140(2005).

    [85] Lee J H, Yanusik I, Choi Y et al. Automotive augmented reality 3D head-up display based on light-field rendering with eye-tracking[J]. Optics Express, 28, 29788-29804(2020).

    [86] Matsumoto T, Kusafuka K, Hamagishi G et al. P-87: glassless 3D head up display using parallax barrier with eye tracking image processing[J]. SID Symposium Digest of Technical Papers, 49, 1511-1514(2018).

    [87] Kang D, Ma L. Real-time eye tracking for bare and sunglasses-wearing faces for augmented reality 3D head-up displays[J]. IEEE Access, 9, 125508-125522(2021).

    [88] Xue G L, Liu J, Li X et al. Multiplexing encoding method for full-color dynamic 3D holographic display[J]. Optics Express, 22, 18473-18482(2014).

    [91] Teich M, Schuster T, Leister N et al. Real-time, large-depth holographic 3D head-up display: selected aspects[J]. Applied Optics, 61, B156-B163(2022).

    [92] Wakunami K, Hsieh P Y, Oi R et al. Projection-type see-through holographic three-dimensional display[J]. Nature Communications, 7, 1-7(2016).

    [93] Ma X L, Yuan R Y, Zhang L B et al. Augmented reality autostereoscopic 3D display based on sparse reflection array[J]. Optics Communications, 510, 127913(2022).

    [94] Shi J C, Qiao W, Hua J Y et al. Spatial multiplexing holographic combiner for glasses-free augmented reality[J]. Nanophotonics, 9, 3003-3010(2020).

    [95] Lu F, Hua J Y, Zhou F B et al. Pixelated volume holographic optical element for augmented reality 3D display[J]. Optics Express, 30, 15929-15938(2022).

    [96] Xu M Q. On the minimum resolution angle of human eyes[J]. China University Teaching, 30-31(1990).

    [97] Li K, Bai L, Li Y G et al. Distortion correction algorithm of AR-HUD virtual image based on neural network model of spatial continuous mapping[C], 178-183(2020).

    [98] Qiu F Y. HRTF of personalized spectrum correction and its application in virtual auditory[D](2016).

    Tools

    Get Citation

    Copy Citation Text

    Ting Zhou, Wen Qiao, Jianyu Hua, Linsen Chen. Status and Prospect of Augmented Reality Head-Up Display[J]. Laser & Optoelectronics Progress, 2023, 60(8): 0811008

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Imaging Systems

    Received: Jan. 11, 2023

    Accepted: Feb. 22, 2023

    Published Online: Apr. 13, 2023

    The Author Email: Qiao Wen (wqiao@suda.edu.cn)

    DOI:10.3788/LOP230490

    Topics