Photonics Research, Volume. 11, Issue 2, 313(2023)

High-speed rendering pipeline for polygon-based holograms

Fan Wang*, Tomoyoshi Ito, and Tomoyoshi Shimobaba
Author Affiliations
  • Graduate School of Engineering, Chiba University, Chiba 263-8522, Japan
  • show less
    Figures & Tables(23)
    Schematic of (a) affine transformation of two triangles and (b) triangular mesh diffraction with carrier wave.
    Schematic diagram of the sampling strategy for (a) the band-limited, (b) the band-extended, and (c) the controllable energy angular spectrum methods. The blue areas are the effective bandwidth. The blue dots are the effective sampling points. The white circles are zero-padded. δf, δfBE, and δfCE are the sampling intervals of the three methods.
    (a) Rasterized triangle in the canvas under the parameters in Table 1. (b) Spectral energy density distributions at different frequency boundaries. (c) Normalized spectral energy distributions for different regions.
    Small triangle is defined as a reference triangle at the limiting angular resolution of the human eye.
    (a) Quality evaluation of the holograms obtained by the CE-ASM by PSNR (left) and SSIM (right) at different η values. The reference holograms are obtained by the BE-ASM with the expanded spectra. (b) Spectral range (left) and the number of sampling (right) of the CE-ASM on the x axis at different η values. The hologram has 1920×1080 pixels.
    (a) and (b) are holograms generated with the extended spectral region (BE-ASM) and the proposed compact spectral region (CE-ASM), respectively. (c) and (d) are the numerical reconstructions of (a) and (b), respectively. With the results of the extended spectral region as references, (b) and (d) show image quality by PSNR and SSIM.
    (a) Phong shading model: obtaining the normal of each pixel using linear interpolation based on three known vertex normals. (b) Schematic of interpolation of pixel normals within a triangle. (c) Blinn–Phong reflection model. L^ points along the direction of the light source. (d) Diffuse reflection diagram. (e) Specular reflection diagram.
    (a) Teapot with 1560 triangles and (b) rings with 5760 triangles located in the 3D space are illuminated by the light ray −L^ and observed with the vector −V^. (c) and (d) are reconstructed images of the teapot and rings rendered with the flat shading model, respectively.
    Schematic of continuous shading method without specular reflection proposed by Park et al. [32]. On the left is the spatial triangle in global coordinate system and on the right is the original triangle in local coordinate system. An affine transformation exists between them.
    Reconstructed results of Park et al.’s shading method (first column) and of the proposed sub-triangle-based shading method (columns 2 to 6). Teapot (a) and rings (b) are subdivided at M=2 to 6 in the proposed method. All results follow the Blinn–Phong reflection model and the parameters given in Table 3.
    Schematic of subdividing the mother triangle ΔABC at M=5, yielding 16 up sub-triangles and 9 down sub-triangles. ΔAB′C′ and ΔA′B′C′ are the original upper and lower sub-triangles, respectively.
    Efficiency comparison between the Park et al.’s method (solid line) and the proposed method (dashed line) at different values of M. From Fig. 11, M denotes the subdivision level of the mother triangle. The Park et al.’s method is independent of M; thus, it behaves as a constant as M increases.
    (a) Schematic diagram of backface culling and occlusion culling. (b) Schematic diagram of collision detection.
    Schematic diagram of an octree structure. A cube encloses the object, and then splits separately into eight children boxes. Empty boxes, such as boxes 2 and 3, and leaf boxes, such as box 7, stop splitting. However, the non-empty boxes (1 and 6) continue to split until a leaf box or empty box appears. Each leaf box contains a vertex set, which forms a set of triangles. The triangle set affiliated with a certain leaf box is the object of performing the intersection test.
    Reconstructed results by the proposed occlusion culling method. (a) Results of computing only the set of T0 triangles whose three vertices are visible. The teapot and ring were subdivided with M0=5 and M0=3, respectively, to smooth the shading. (b) Results of filling the set of T1 and T2 triangles after occlusion culling. (c) Reconstructed images from the optical experiments.
    Schematic diagram of occlusion culling. (a) Triangle set T1 with one vertex obscured and divided into M12 congruent sub-triangles. (b) Triangle set T2 with two vertices obscured and divided into M22 congruent sub-triangles. Blue sub-triangles are culled because they have at least one occluded vertex. (c)–(e) Three special cases that are occluded but cannot be properly addressed by the proposed method.
    Reconstructed images of all 3D objects referred in this paper. They are subjected to the proposed occlusion culling at the subdivision of M0,M1, and M2. The number of triangles for each object is given in Table 2. Shading rendering follows the method proposed in Section 4. (a) Numerically reconstructed images, and (b) experimentally reconstructed images.
    Flowchart of the proposed high-speed rendering pipeline for the polygon-based holograms.
    Numerical reconstruction of the ultra-high-resolution hologram of the Thai statue. The Thai statue contains 1,000,000 triangles and is subdivided by M0=M1=M2=3. The full running time in the pipeline is 607 s.
    • Table 1. Frequency Parameters of Different Sampling Methods

      View table
      View in Article

      Table 1. Frequency Parameters of Different Sampling Methods

      ParametersValues
      Hologram pixelsNx=1920,Ny=1080
      Pixel pitchp=3.74  μm
      Physical sizeLx=7.18  mm,Ly=4.03  mm
      Wavelengthλ=532  nm
      Diffraction distanced=250  mm
      Reference trianglel=0.058  mm
      Vertices of the triangle(0,0,d),(0,l,d),(l,l,d)
      (fxmax,fymax)(133.7,133.7)mm1
      2Nx×2Ny3840×2160
      (fxBE,fyBE)(95.0,71.2)mm1
      NxBE×NyBE3840×2160
      (fxBL,fyBL)(67.5,40.0)  mm1
      NxBL×NyBL1938×613
      (fxCE,fyCE)(40.7,22.1)mm1
      NxCE×NyCE706×208
    • Table 2. Calculated Results and Comparison for Objects Composed of Different Numbers of Triangles

      View table
      View in Article

      Table 2. Calculated Results and Comparison for Objects Composed of Different Numbers of Triangles

      ObjectsTeapotRingsHandSoccerWangBunnyAngel
      Number of triangles15605760842012,28218,22832,03064,363
      Extended spectra (s)5.232.557.178.85119.9203.1417.7
      Compact spectra (s) (proposed)0.41.22.02.704.06.613.7
      Acceleration14.126.028.629.229.830.830.5
      PSNRa4445.142.446.25146.347.4
      SSIMa0.950.970.960.970.990.960.97
    • Table 3. Parameters Used in the Shading Modela

      View table
      View in Article

      Table 3. Parameters Used in the Shading Modela

      IlluminationL^V^KaKdKsNs
      ϕx=70°(cosϕx,cosϕy,cosϕz)(0,0,1)0.20.80.825
      ϕy=85°
    • Table 4. Elapsed Time Using the Proposed Occlusion Culling Method

      View table
      View in Article

      Table 4. Elapsed Time Using the Proposed Occlusion Culling Method

      ModelsaBackface Culling Only (s)Occlusion Culling (s)Extra Costs
      OctreeDetectionTotal
      Teapot1.420.0050.0751.8228.2%
      Rings3.790.020.134.2311.6%
      Hand4.880.040.145.165.7%
      Soccer6.510.070.166.987.2%
      Wang9.940.100.4210.869.3%
      Bunny21.780.541.1823.538.0%
      Angel26.640.681.5328.396.6%
    Tools

    Get Citation

    Copy Citation Text

    Fan Wang, Tomoyoshi Ito, Tomoyoshi Shimobaba. High-speed rendering pipeline for polygon-based holograms[J]. Photonics Research, 2023, 11(2): 313

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Holography, Gratings, and Diffraction

    Received: Aug. 29, 2022

    Accepted: Dec. 19, 2022

    Published Online: Feb. 8, 2023

    The Author Email: Fan Wang (wangfan@chiba-u.jp)

    DOI:10.1364/PRJ.474158

    Topics