Phong shading approximation of computer-generated holography based on fully analytical triangle meshes

Xi Zou; Qingyang Fu; Yan Liu; Min Yang; Pin Wang; Yaping Zhang; Ting-Chung Poon

doi:10.3788/COL202523.040501

1. Introduction

Recording and recreating three-dimensional (3D) scenes can be done using holography as a useful tool. The data generation of digital holograms known as computer-generated holograms (CGHs) involves simulating the light waves in the process of optical holographic recording, which includes modeling and simulating phenomena such as reflection, diffraction, propagation, and interference of light in computers. CGHs can be transmitted to the spatial light modulator for display. The three commonly used methods for generating CGH are the point-based method^[1], the layer-based method^[2–4], and the polygon-based method^[5–7]. Due to their computational simplicity, point-based methods have been rapidly developed. Point-based CGHs become more efficient with the use of lookup table methods^[8], wave-front recording plane methods^[9], parallel computation in GPUs^[10], and field-programmable gate arrays^[11]. In layer-based methods, Yao et al.^[12] recently proposed a method of generating holograms using adaptive algorithms to reduce the depth error of reconstructed images. In polygon-based methods, Fu et al.^[7] proposed a complete analysis method using self-similarity segmentation along with a parallelogram approximation. They have also used texture mapping to render objects, thereby reducing a large amount of computational workload in high-precision texture rendering.

Polygon-based computer-generated holography has many advantages including compatibility with conventional computer graphics techniques and efficient representation of large 3D scenes. One of the polygon-based computer-generated holography methods is the traditional FFT-based method, which requires two FFTs and interpolation to obtain the spectrum of the polygon on the hologram plane^[13,14]. However, interpolation reduces the calculation speed of hologram generation. An alternative method within polygon-based computer-generated holography is the fully analytical approach, which computes the spectrum of the arbitrary triangular mesh using affine transform^[15–17]. There are multiple challenges associated with implementing a 3D display using computer-generated holography. Enhancing the fidelity of the reconstructed images presents a significant hurdle in this endeavor. When reconstructing a 3D scene, it is essential to account for the amplitude of the triangles, considering factors such as the illumination direction and the triangle’s normal vector^[16,17]. Employing uniform amplitude distribution within each triangle leads to what is known as flat shading. However, the realism of the reconstruction is hindered by the visibility of mesh boundaries caused by flat shading. Park et al. used a continuous shading method to provide continuously changing amplitudes within each triangle. However, the exaggeration of polygon edges still affects the fidelity of 3D reconstruction^[6]. On this basis, Yeom et al. proposed the use of discrete convolution to achieve the addition of object reflection highlights. However, due to the large computational complexity of discrete convolution, computational efficiency is reduced^[18]. Wang et al. proposed using the Blinn Phong reflection model, replacing diffuse and specular reflections with an approximately exponential function and implementing the addition of highlights in a fully analytical algorithm, but there are still cases of discontinuous polygonal edges^[19].

To solve the problem of edge discontinuity in polygon reconstruction for 3D objects, we propose a Phong shading approximation method. It involves dividing the (primitive) unit triangle into sub-triangles by segmentation in the fully analytical approach to determine the amplitude of each point within the sub-triangles, thereby achieving an approximation of Phong shading. The proposed method effectively eliminates bright line artifacts along the edges of polygonal meshes on object surfaces and ultimately produces superior surface approximations. The proposed method rigorously uses the Phong reflection model^[20] and has been validated through simulations and optical reconstructions of multiple 3D objects.

In Sec. 2, we summarize the theory of polygon-based method based on affine transformation. In Sec. 3, we discuss continuous shading. In Sec. 4, we derive a complete analytical form of Phong shading approximation using self-similarity segmentation and linear interpolation. In Sec. 5, we demonstrate numerical and optical reconstructions to verify the effectiveness of our proposed technique. Concluding remarks will be provided in Sec. 6.

2. Analytical Spectrum in a Hologram due to an Arbitrary Tilted Polygon

In this section, we briefly summarize the important results of the fully analytic triangular mesh algorithm used for computer-generated holograms^{[16,17,21–23]}. In the global coordinate system $O - x y z$ as shown in Fig. 1, an $i$ th arbitrarily tilted polygon of the 3D object is shown. Its spectrum on the hologram plane ( $z = 0$ ) is given by^[24–26] $G_{i} (f_{x}, f_{y}) = \iint a_{i} [x, y; z (x, y)] \exp {- j 2 π [f_{x} x + f_{y} y + f_{z} z - \frac{z (x, y)}{λ}]} d x d y,$ (1)where $λ$ is the wavelength of light. $f_{x}$ , $f_{y}$ , and $f_{z}$ are the spatial frequencies along the $x$ , $y$ , and $z$ directions with $f_{z} = \sqrt{\frac{1}{λ^{2}} - f_{x}^{2} - f_{y}^{2}}$ . $z (x, y)$ is the distance between a point on the tilted plane and the hologram plane, and $a_{i}$ is the amplitude of the $i$ th arbitrarily tilted triangle given by $a_{i} [x, y; z (x, y)] = {\begin{matrix} 1, & inside triangle \\ 0, & outside triangle \end{matrix} .$ (2)

Figure 1.Relationship of an arbitrary triangle and the hologram plane.

Download full size

View all figures

The brightness factor for shading rendering can be determined by the amplitude of the triangle. In traditional methods, it is assumed that the amplitude of each triangle is uniform. Therefore, the 3D scene is represented by what is known as flat shading, which lacks realism upon hologram reconstruction.

In the fully analytic triangular mesh algorithm, the spectrum of the tilted triangle on the hologram plane is expressed in terms of the spectrum of a primitive triangle (unit right triangle) through affine transformation. If the affine coordinates of the three vertices of the primitive triangle on the $x_{r} y_{r}$ plane are (0,0), (1,0), and (0,1), and the coordinates of the vertex of the $i$ th arbitrary triangle on the global coordinate system $O - x y z$ are $(x_{i 1}, y_{i 1}, z_{i 1}), (x_{i 2}, y_{i 2}, z_{i 2})$ , and $(x_{i 3}, y_{i 3}, z_{i 3})$ , we have the following relation: $[\begin{matrix} x \\ y \\ z \end{matrix}] = [\begin{matrix} (x_{i 2} - x_{i 1}) (x_{i 3} - x_{i 1}) x_{i 1} \\ (x_{i 2} - y_{i 1}) (y_{i 3} - y_{i 1}) y_{i 1} \\ (z_{i 2} - z_{i 1}) (z_{i 3} - z_{i 1}) z_{i 1} \end{matrix}] [\begin{matrix} x_{r} \\ y_{r} \\ 1 \end{matrix}] .$

With this relation, Eq. (1) can be finally expressed as $G_{i} (f_{x}, f_{y}) = J \cdot p \cdot \iint a_{r} (x_{r}, y_{r}) \exp (- j 2 π f_{x i}^{'} x_{r}) \exp (- j 2 π f_{y i}^{'} y_{r}) d x_{r} d y_{r} .$ (3)

In Eq. (3), $a_{r}$ is the amplitude of the primitive triangle, $a_{r} (x_{r}, y_{r}) = {\begin{matrix} 1, & inside primitive triangle \\ 0, & outside primitive triangle \end{matrix}, J = | \begin{matrix} \frac{\partial x_{r}}{\partial x} \frac{\partial x_{r}}{\partial y} \\ \frac{\partial y_{r}}{\partial x} \frac{\partial y_{r}}{\partial y} \end{matrix} | = | x_{i 2} y_{i 3} + x_{i 1} y_{i 1} + x_{i 1} y_{i 2} - x_{i 3} y_{i 2} |, f_{x i}^{'} = (x_{i 2} - x_{i 1}) f_{x} + (y_{i 2} - y_{i 1}) f_{y} + (z_{i 2} - z_{i 1}) f_{z} - \frac{z_{i 2} - z_{i 1}}{λ}, f_{y i}^{'} = (x_{i 3} - x_{i 1}) f_{x} + (y_{i 3} - y_{i 1}) f_{y} + (z_{i 3} - z_{i 1}) f_{z} - \frac{z_{i 3} - z_{i 1}}{λ}, p = \exp [- j 2 π (x_{i 1} f_{x} + y_{i 1} f_{y} + z_{i 1} f_{z} - z_{i 1} / λ)] .$

Now, the primitive triangle’s analytical spectrum $G_{r} (f_{x}^{'}, f_{y}^{'})$ is given by $G_{r} (f_{x}^{'}, f_{y}^{'}) = \iint_{.} a_{r} (x_{r}, y_{r}) \exp [- j 2 π (x_{r} f_{x}^{'} + y_{r} f_{y}^{'})] d x_{r} d y_{r} = \int_{0}^{1} \int_{0}^{- x_{r} + 1} 1 \cdot \exp [- j 2 π (x_{r} f_{x}^{'} + y_{r} f_{y}^{'})] d x_{r} d y_{r} = \frac{\exp (- j 2 π f_{x}^{'}) - 1}{4 π^{2} f_{x}^{'} f_{y}^{'}} - \frac{\exp (- j 2 π f_{x}^{'}) - \exp (- j 2 π f_{y}^{'})}{4 π^{2} (f_{x}^{'} - f_{y}^{'}) f_{y}^{'}} .$ (4)

Comparing Eqs. (3) and (4), we have $G_{i} (f_{x}, f_{y}) = J \cdot p \cdot G_{r} (f_{x i}^{'}, f_{y i}^{'}) .$ (5)

In the polygon-based method, the total light field distribution $U_{O} (x, y)$ on the hologram plane is the superposition of the light fields emitted by all polygons (triangles). The total optical field distribution $U_{O} (x, y)$ can be obtained by inverse Fourier transform of the total spectrum obtained from all the arbitrary triangles $G_{i} (f_{x}, f_{y})$ : $U_{O} (x, y) = F^{- 1} {\sum_{i = 1}^{n} [J \cdot p \cdot G_{r} (f_{x i}^{'}, f_{y i}^{'})]},$ (6)where $F^{- 1}$ represents the inverse Fourier transform and $n$ denotes the number of triangles of the 3D object.

3. Continuous Shading

The Chevreul illusion^[27] manifests as an optical effect where, between two adjacent triangles, if one triangle has a stronger contrast, it causes our visual system to perceive boundaries between these adjacent triangles. To address the Chevreul illusion^[27], Park et al. proposed a continuous shading model that interpolates the amplitudes within the primitive triangle based on the amplitudes of the three vertices of the primitive triangle. Therefore, Park et al.’s method is essentially Gouraud shading model^[6].

The coordinates of the three vertices of the primitive triangle on the $x_{r} y_{r}$ plane are $V_{1} (0, 0), V_{2} (0, 1)$ , and $V_{3} (1, 0)$ . ${\hat{n}}_{v, 1}$ , ${\hat{n}}_{v, 2}$ , and ${\hat{n}}_{v, 3}$ are the known three vertex unit normal vectors of the arbitrary triangle in $x y z$ -coordinates, respectively, as shown in Fig. 2. Park et al. used the Phong reflection model to determine the amplitude $a_{ν, 1}$ , $a_{ν, 2}$ , and $a_{ν, 3}$ of the three vertices of the primitive triangle according to $a_{ν, i} = a_{ν, i, o} (k_{a} + k_{d} {\hat{n}}_{v, i} \cdot \hat{L}), i = 1, 2, 3,$ (7)where $a_{ν, i, o}$ and ${\hat{n}}_{v, i}$ represent the reflectance and normal vector, respectively, and $\hat{L}$ is the illumination vector. The ratio of ambient to diffusive reflection is dictated by the two coefficients, $k_{a}$ and $k_{a}$ . Utilizing the amplitudes of $a_{ν, 1}$ , $a_{ν, 2}$ , and $a_{ν, 3}$ , the amplitude $g_{r} (x_{r}, y_{r})$ of pixels $(x_{r}, y_{r})$ within the primitive triangle is linearly interpolated as $g_{r} (x_{r}, y_{r}) = {\begin{matrix} (a_{ν, 3} - a_{ν, 1}) x_{r} + (a_{ν, 2} - a_{ν, 1}) y_{r} + a_{ν, 1}, & inside triangle \\ 0, & outside triangle \end{matrix} .$ (8)

Figure 2.Mapping between (unit right triangle) primitive triangle and arbitrary triangle.

Download full size

View all figures

Hence, $a_{r} (x_{r}, y_{r})$ within the primitive triangle in Eq. (3) can now be given by $a_{r} (x_{r}, y_{r}) = g_{r} (x_{r}, y_{r}) .$ (9)

The angular spectrum of the primitive triangle $G_{r} (f_{x}^{'}, f_{y}^{'})$ can be obtained as $G_{r} (f_{x}^{'}, f_{y}^{'}) = (a_{ν, 3} - a_{ν, 1}) D_{1} + (a_{ν, 2} - a_{ν, 1}) D_{2} + a_{ν, 1} D_{3},$ (10)where $D_{1} (f_{x}^{'}, f_{y}^{'}) = \int_{0}^{1} \int_{0}^{1 - x_{r}} x_{r} \exp [- j 2 π (x_{r} f_{x}^{'} + y_{r} f_{y}^{'})] d x_{r} d y_{r} = \frac{1}{8 π^{3} f_{y}^{'}} j {\frac{e^{- 2 j π f_{x}^{'}} (- 2 j π f_{x}^{'} + e^{2 j π f_{x}^{'}} - 1)}{f_{x}'^{2}} + \frac{e^{- 2 j π (f_{x}^{'} + f_{y}^{'})} {e^{2 j π f_{y}^{'}} [1 + 2 j π (f_{x}^{'} - f_{y}^{'})] - e^{2 j π f_{x}^{'}}}}{{(f_{x}^{'} - f_{y}^{'})}^{2}}},$ (11) $D_{2} (f_{x}^{'}, f_{y}^{'}) = \int_{0}^{1} \int_{0}^{1 - x_{r}} y_{r} \exp [- j 2 π (x_{r} f_{x}^{'} + y_{r} f_{y}^{'})] d x_{r} d y_{r} = \frac{e^{- 2 j π (f_{x}^{'} + 2 f_{y}^{'})} [j e^{2 j π (f_{x}^{'} + 2 f_{y}^{'})} {(f_{x}^{'} - f_{y}^{'})}^{2}]}{8 π^{3} f_{x}^{'} f_{y}'^{2} (f_{x}^{'} - f_{y}^{'})^{2}} + \frac{f_{x}^{'} e^{2 j π (f_{x}^{'} + f_{y}^{'})} [f_{x}^{'} (2 π f_{y}^{'} - j) - 2 f_{y}^{'} (π f_{y}^{'} - j)] - j e^{4 j π f_{y}^{'}} f_{y}^{' 2}}{8 π^{3} f_{x}^{'} f_{y}^{' 2} (f_{x}^{'} - f_{y}^{'})^{2}},$ (12) $D_{3} (f_{x}^{'}, f_{y}^{'}) = \int_{0}^{1} \int_{0}^{1 - x_{r}} 1 \cdot \exp [- j 2 π (x_{r} f_{x}^{'} + y_{r} f_{y}^{'})] d x_{r} d y_{r} = \frac{\exp (- j 2 π f_{x}^{'}) - 1}{4 π^{2} f_{x}^{'} f_{y}^{'}} - \frac{\exp (- j 2 π f_{x}^{'}) - \exp (- j 2 π f_{y}^{'})}{4 π^{2} (f_{x}^{'} - f_{y}^{'}) f_{y}^{'}} .$ (13)

By incorporating Eq. (10) into Eq. (6), Park et al. obtained a fully analytical spectrum with continuous shading. However, after numerical reconstruction, we have found significant discontinuities between the edges of the object surface polygons and bright line artifacts appear on the polygonal edges of the object surface reconstruction. To address this issue, we propose a Phong shading approximation method to make the surface of the object smoother, which will be detailed in Sec. 5 along with Park et al.’s results for comparison.

4. Proposed Shading Method: Approximate Phong Shading Rendering

In the proposed method, we use a simple Phong reflection model that includes ambient reflection and diffuse reflection, which provides the amplitude $a$ of each surface point^[20]: $a = k_{a} + k_{d} (\hat{n} \cdot \hat{L}),$ (14)where $k_{a}$ and $k_{d}$ are the ambient and diffuse reflection coefficients, respectively, $\hat{n}$ is the unit normal vector, and $\hat{L}$ is the unit vector pointing toward the light source. This equation is reminiscent of Eq. (7).

In Fig. 3, we denote $(m, n)$ as an index value along the two unit lengths of the primitive triangle. The index value describes the position of the sub-triangle. Figure 3 also illustrates the coordinates of the vertices of $(m, n)$ sub-triangles (forward in green and reverse in orange). Each side of the unit triangle is divided into segments of length $1 / M$ , and $(m, n)$ is used as the index value along the two unit lengths. Therefore, we can easily obtain the vertex coordinates of $(m, n)$ sub-triangles (green forward and orange reverse, as shown in Fig. 3. ${\hat{n}}_{ν, 1}^{'}$ , ${\hat{n}}_{ν, 2}^{'}$ , and ${\hat{n}}_{ν, 3}^{'}$ are the vertex normals of the primitive triangle, as shown in Fig. 3. In our work, similar to Eq. (8), we use the vertex coordinates of the sub-triangle shown in Fig. 3 to obtain the vertex normals of the sub-triangle by linearly interpolating the vertex normals of the primitive triangle. The vertex normals $n_{F, 1}$ , $n_{F, 2}$ , and $n_{F, 3}$ of the forward triangle $F (m, n)$ and the vertex normals $n_{R, 1}$ , $n_{R, 2}$ , and $n_{R, 3}$ of the reverse triangle $R (m, n)$ are obtained by the following equations: $n_{F, 1} (m, n) = ({\hat{n}}_{ν, 3}^{′} - {\hat{n}}_{ν, 1}^{′}) \cdot \frac{m}{M} + ({\hat{n}}_{ν, 2}^{′} - {\hat{n}}_{ν, 1}^{1}) \cdot \frac{n}{M} + {\hat{n}}_{ν, 1}^{′}, n_{R, 1} (m, n) = ({\hat{n}}_{ν, 3}^{′} - {\hat{n}}_{ν, 1}^{′}) \cdot \frac{m + 1}{M} + ({\hat{n}}_{ν, 2}^{′} - {\hat{n}}_{ν, 1}^{′}) \cdot \frac{n + 1}{M} + {\hat{n}}_{ν, 1}^{′}, n_{F, 2} (m, n) = n_{R, 2} (m, n) = ({\hat{n}}_{ν, 3}^{′} - {\hat{n}}_{ν, 1}^{′}) \cdot \frac{m}{M} + ({\hat{n}}_{ν, 2}^{′} - {\hat{n}}_{ν, 1}^{′}) \cdot \frac{n + 1}{M} + {\hat{n}}_{ν, 1}^{′}, n_{F, 3} (m, n) = n_{R, 3} (m, n) = ({\hat{n}}_{ν, 3}^{′} - {\hat{n}}_{ν, 1}^{′}) \cdot \frac{m + 1}{M} + ({\hat{n}}_{ν, 2}^{′} - {\hat{n}}_{ν, 1}^{′}) \cdot \frac{n}{M} + {\hat{n}}_{ν, 1}^{′} .$ (15)

Figure 3.Coordinates and vertex normals of sub-triangles.

Download full size

View all figures

We denote ${\hat{n}}_{F, i} (m, n)$ and ${\hat{n}}_{R, i} (m, n)$ as the normalized vertex normals of the forward and reverse sub-triangles, respectively, as follows: ${\hat{n}}_{F, i} (m, n) = \frac{n_{F, i} (m, n)}{∥ n_{F, i} (m, n) ∥}, i = 1, 2, 3, {\hat{n}}_{R, i} (m, n) = \frac{n_{R, i} (m, n)}{∥ n_{R, i} (m, n) ∥}, i = 1, 2, 3 .$

Using the simple Phong reflection model given by Eq. (14), we can now obtain the amplitudes $a_{F, 1}$ , $a_{F, 2}$ , and $a_{F, 3}$ of the vertices of the forward sub-triangles, $F (m, n)$ , and the amplitudes $a_{R, 1}$ , $a_{R, 2}$ , and $a_{R, 3}$ of the vertices of the reverse sub-triangles, $R (m, n)$ as follows: $a_{F, 1} (m, n) = K_{a} + K_{d} [{\hat{n}}_{F, 1} (m, n) \cdot \hat{L}], a_{R, 1} (m, n) = K_{a} + K_{d} [{\hat{n}}_{R, 1} (m, n) \cdot \hat{L}], a_{F, 2} (m, n) = a_{R, 2} (m, n) = K_{a} + K_{d} [{\hat{n}}_{F, 2} (m, n) \cdot \hat{L}], a_{F, 3} (m, n) = a_{R, 3} (m, n) = K_{a} + K_{d} [{\hat{n}}_{F, 3} (m, n) \cdot \hat{L}],$ (16)where $a_{F, 2} = a_{R, 2}$ and $a_{F, 3} = a_{R, 3}$ are evident from Fig. 3. Finally, the amplitude $g_{F} (x_{r}, y_{r}, m, n)$ of pixels $(x_{r}, y_{r})$ within the forward sub-triangles and the amplitude $g_{R} (x_{r}, y_{r}, m, n)$ of pixels $(x_{r}, y_{r})$ within the reverse sub-triangles are linearly interpolated as $g_{F} (x_{r}, y_{r}, m, n) = {\begin{cases} [a_{F, 3} (m, n) - a_{F, 1} (m, n)] x_{r} (m, n) + [a_{F, 2} (m, n) - a_{F, 1} (m, n)] y_{r} (m, n) + a_{F, 1} (m, n), & inside of F (m, n) \\ 0, & outside of F (m, n) \end{cases} .$ (17) $g_{R} (x_{r}, y_{r}, m, n) = {\begin{cases} [a_{R, 2} (m, n) - a_{R, 1} (m, n)] x_{r} (m, n) + [a_{R, 3} (m, n) - a_{R, 1} (m, n)] y_{r} (m, n) + a_{R, 1} (m, n), & inside of R (m, n) \\ 0, & outside of R (m, n) \end{cases} .$ (18)

In our method, the subdivision is crucial for approximating Phong shading, as only subdivision can obtain the vertex normals of the sub-triangles through interpolation and calculate the amplitudes within the sub-triangles. Our work combines continuous shading^[6] and subdivision to derive the amplitude within the sub-triangles, ensuring that the amplitude within the sub-triangles is nonuniform.

For general index values $(m, n)$ , we can find the spectra of forward sub-triangles $F (m, n)$ and Reverse sub-triangles $R (m, n)$ , using the integral limits shown in Fig. 6 of Fu et al.’s method^[7]: $G_{F} (f_{x}^{'}, f_{y}^{'}, m, n) = \int_{\frac{m}{M}}^{\frac{m + 1}{M}} \int_{\frac{n}{M}}^{- x_{r} + \frac{m + n + 1}{M}} g_{F} (x_{r}, y_{r}, m, n) \cdot \exp [- j 2 π (x_{r} f_{x}^{'} + y_{r} f_{y}^{'})] d x_{r} d y_{r} = \frac{1}{M} {[a_{F, 3} (m, n) - a_{F, 1} (m, n)] \cdot D_{1} (\frac{f_{x}^{'}}{M}, \frac{f_{y}^{'}}{M}) + [a_{F, 2} (m, n) - a_{F, 1} (m, n)] \cdot D_{2} (\frac{f_{x}^{'}}{M}, \frac{f_{y}^{'}}{M}) + a_{F, 1} (m, n) \cdot D_{3} (\frac{f_{x}^{'}}{M}, \frac{f_{y}^{'}}{M})} \exp [- j 2 π (\frac{m}{M}) f_{x}^{'} - j 2 π (\frac{n}{M}) f_{y}^{'}],$ (19) $G_{R} (f_{x}^{'}, f_{y}^{'}, m, n) = \int_{\frac{m}{M}}^{\frac{m + 1}{M}} \int_{- x_{r} + \frac{m + n + 1}{M}}^{\frac{n + 1}{M}} g_{R} (x_{r}, y_{r}, m, n) \cdot \exp [- j 2 π (x_{r} f_{x}^{'} + y_{r} f_{y}^{'})] d x_{r} d y_{r} = \frac{1}{M} {[a_{R, 2} (m, n) - a_{R, 1} (m, n)] \cdot D_{1} (- \frac{f_{x}^{'}}{M}, - \frac{f_{y}^{'}}{M}) + [a_{R, 3} (m, n) - a_{R, 1} (m, n)] \cdot D_{2} (- \frac{f_{x}^{'}}{M}, - \frac{f_{y}^{'}}{M}) + a_{R, 1} (m, n) \cdot D_{3} (- \frac{f_{x}^{'}}{M}, - \frac{f_{y}^{'}}{M})} \times \exp [- j 2 π (\frac{m - 1}{M}) f_{x}^{'} - j 2 π (\frac{n + 1}{M}) f_{y}^{'}] .$ (20)

The calculation results for $D_{1} (f_{x}^{'}, f_{y}^{'})$ , $D_{2} (f_{x}^{'}, f_{y}^{'})$ , and $D_{3} (f_{x}^{'}, f_{y}^{'})$ have been given by Eqs. (11 )–(13). The sum of all the spectra of the forward and reverse sub-triangles gives the spectra of the primitive triangle: $G (f_{x}^{'}, f_{y}^{'}) = \sum_{m = 0}^{M - 1} \sum_{n = 0}^{M - 1} G_{F} (f_{x}^{'}, f_{y}^{'}, m, n) + \sum_{m = 0}^{M - 2} \sum_{n = 0}^{M - 2} G_{R} (f_{x}^{'}, f_{y}^{'}, m, n),$ (21)where $G (f_{x}^{'}, f_{y}^{'})$ is the spectrum of a primitive triangle with what we call an approximate Phong shading rendering method. Finally, we obtain the distribution of the object’s light field with approximate Phong shading rendering information using Eq. (6): $U_{O} (x, y) = F^{- 1} {\sum_{i = 1}^{n} [J \cdot p \cdot G (f_{x i}^{'}, f_{y i}^{'})]} .$ (22)

We would also like to point out that Wang et al.^[28] recently proposed a method for simulating Phong shading using segmentation. A significant difference between our work and the method proposed by Wang et al. is that it solely employs a triangular subdivision method to simulate Phong shading, where the amplitude within the sub-triangle is determined by the amplitude at the barycenter of the sub-triangle, resulting in a uniform amplitude. In contrast, our work combines self-similar subdivision and continuous shading methods, where the amplitude within the sub-triangle is determined by interpolating the amplitudes of the three vertices of the sub-triangle, resulting in nonuniform amplitudes.

5. Simulations and Experimental Results

To validate the proposed method, holograms of 3D objects with different numbers of triangles were generated based on Eq. (22). We utilized various shadow models and conducted numerical and optical reconstructions to assess the results. For numerical reconstruction, we have generated the holograms with a resolution of $1024 pixel \times 1024 pixel$ with a pixel pitch of 8 µm and wavelength of 0.532 µm. The hardware includes CPU: Intel(R) Xeon(R) Gold 6226 R CPU at 2.90 GHz without using a GPU. For optical reconstruction, the model of the spatial light modulator (SLM) is HOLOEYE PLUTO2 (NIR-011) with a resolution of $1920 \times 1080$ (Full HD 1080p) and with a pixel pitch of 8 µm. The active area is $15.36 mm \times 8.64 mm$ . The wavelength of the light wave emitted by the laser is 0.532 µm. The image receiver is an MMRY UC900C charge-coupled device.

Two holograms are generated using the continuous shading method proposed by Park et al. and our Phong shading approximation method, using a sphere as a first example. Figure 4 shows the numerical reconstruction results. Regarding the hologram reconstruction produced by Park et al.’s continuous shading method, as shown in Fig. 4(a), it can be clearly seen that there is a noticeable discontinuity between the edges of the polygon. Figures 4(b) and 4(c) show the reconstructed images of our method with different subdivisions $M$ . In the proposed method shown in Fig. 4(c), a smooth appearance of the surface can be observed with a larger $M$ , successfully eliminating the inappropriate brightness of the polygon edges. The lighting parameters employed for the Phong reflection model are given as follows : $K_{a} = 0.2$ , $K_{d} = 0.8$ , and $\hat{L} = (0, 0, 1)$ .

Figure 4.Numerically reconstructed images of the sphere. (a) Park’s shading method: continuous shading. (b) and (c) Proposed shading method: Phong shading approximation. The sphere is subdivided at M = 2 in (b) and M = 3 in (c).

Download full size

View all figures

In Fig. 5(a), reconstruction without shadows is depicted, employing uniform amplitude across all triangles. Figure 5(b) displays the hologram reconstruction utilizing flat shading, where the amplitude within each triangle of the 3D object is uniform. This uniform amplitude results in a uniform brightness within each reconstructed mesh surface, causing a sudden change in brightness between adjacent meshes. Figure 5(c) illustrates the hologram’s reconstruction employing Park et al.’s continuous shading methodology. The continuous shading effect makes the mesh boundaries visible, reducing the realism of the reconstruction. Figure 5(d) illustrates the reconstruction utilizing the proposed technique, which achieves better surface approximation and eliminates polygon edges.

Figure 5.Numerically and optically constructed images of the teapot. (a) No shading: The brightness of the entire surface is uniform. (b) Flat shading: The brightness within each triangle of the 3D object is uniform. (c) Park et al.’s shading method: continuous shading. (d) Proposed shading method: Phong shading approximation, with subdivision degree M = 3.

Download full size

View all figures

Figure 6 shows the numerical reconstruction results of the teapot using Wang et al.’s method and the proposed method for different $M$ values. From Fig. 6(a), it is evident that the method proposed by Wang et al. produced noticeable grid edges on the object’s surface at $M = 3$ , achieving a smooth effect at $M = 16$ . In contrast, Fig. 6(b) shows that the proposed method already attained a smooth surface at $M = 3$ . In Fig. 7, we compare the calculation time of five different methods using a teapot as an example. From Figs. 6 and 7, we see that the proposed method achieves a smooth effect at $M = 3$ with a computation time of 175.32 s, while Wang et al.’s method achieves a smooth effect at $M = 16$ with a computation time of 1447.43 s. In comparison, although the overall computation time of our proposed method increases with $M$ and is longer than that of Wang et al.’s method, the advantage of our method lies in achieving a smooth effect in less time. According to Fig. 7, it is evident that the proposed method takes more time than Park et al.’s method, but we can select an appropriate $M$ within the perceptible smooth range of the human eye to achieve the most efficient computation.

Figure 6.Numerically reconstructed images of the teapot. (a) Wang et al.’s shading method: simulate Phong shading. (b) Proposed shading method: Phong shading approximation. Teapot is subdivided at M = 3, M = 8, M = 16, and M = 32.

Download full size

View all figures

Figure 7.Comparison of the calculation time for five different methods. Note that the no shading, flat shading, and Park et al. methods are independent of M.

Download full size

View all figures

Finally, Fig. 8 illustrates the reconstruction of multiple objects. Table 1 shows the size information of the 3D objects used in the experiment. There is a significant difference in realism between the results using the proposed method and those obtained using Park et al.’s method. Therefore, the experimental results shown in Figs. 4, 5, 6, and 8 confirm that the use of Phong shading approximation in the proposed method effectively achieves the better-expected approximation of surface curvature.

Table 1. Size of Different 3D Objects and Numbers of Triangles

View table

View all Tables

Table 1. Size of Different 3D Objects and Numbers of Triangles

Name	Number of triangles	Object size (mm × mm × mm)
Sphere	96	63.81 × 38.97 × 63.68
Circular truncated cone	288	17.69 × 17.87 × 20.40
Teapot	1690	2427.90 × 782.29 × 1189.05
Dinosaur	3011	53.20 × 65.13 × 60.33
Bear	4518	50.67 × 34.69 × 58.40

Figure 8.Numerical reconstruction of (a) Park’s method and (b) the proposed method on complicated 3D objects, with subdivision degree M = 3. (c) Optically reconstructed images of 3D objects: proposed shading method, with subdivision degree M = 3.

Download full size

View all figures

6. Conclusion

In this study, we propose a new Phong shading approximation method of computer-generated holography based on fully analytical triangle meshes, which provides a complete analytical formalism based on Phong shading. The method divides the primitive triangles into multiple sub-triangles (both forward and reverse) and linearly interpolates the vertex normals of the primitive triangles to obtain the vertex normals for the sub-triangles. The Phong reflection model is then used to determine the amplitudes at the vertices of the sub-triangles. Finally, the amplitudes at the vertices of the sub-triangles are linearly interpolated to achieve spatially varying amplitudes within the sub-triangles. During reconstruction, the Phong shading approximation method can be used to render 3D objects, which almost eliminates the bright line artifacts on the surface of 3D objects that occur during holographic reconstruction, thereby improving reconstruction quality compared to the continuous shading methods proposed by Park et al.^[6] We have conducted simulations and optical reconstructions to validate our proposed approach.

Category: Diffraction, Gratings, and Holography

Received: Sep. 4, 2024

Accepted: Nov. 1, 2024

Posted: Nov. 4, 2024

Published Online: Apr. 18, 2025

The Author Email: Yan Liu (liuyan1@ynnu.edu.cn), Yaping Zhang (yaping.zhang@gmail.com)

DOI:10.3788/COL202523.040501

CSTR:32184.14.COL202523.040501