Infrared and Laser Engineering, Volume. 53, Issue 8, 20240204(2024)

Trilateral filter smoothing and denoising algorithm for gated light ranging and imaging

Chenhao XIA1,2, Xinwei WANG1,2,3, Liang SUN1, Bo SONG1,2, Songtao FAN1, and Yan ZHOU1,2,3
Author Affiliations
  • 1Optoelectronic System Laboratory, Institute of Semiconductors, Chinese Academy of Sciences, Beijing 100083, China
  • 2Center of Materials Science and Optoelectronics Engineering, University of Chinese Academy of Sciences, Beijing 100049, China
  • 3School of Electronic, Electrical and Communication Engineering, University of Chinese Academy of Sciences, Beijing 100049, China
  • show less

    ObjectiveThree-dimensional (3D) images provide a stereoscopic view enabling observers to perceive shapes, sizes, and spatial relationships. They play an important role in a variety of applications including computer vision, medical imaging, robotics, autonomous driving, graphics, virtual reality (VR) and augmented reality (AR). 3D range gated imaging (Gated3D) is a light ranging and imaging (LiRAI) technique, which can obtain high-resolution 3D spatial images as well as 2D intensity images, avoiding the heterogeneous data fusion problem in the combined technology of LiDAR and camera. Gated3D can utilize at least two gated images to recover depth information. Similar to existing LiDAR, Gated3D is also influenced by device noise, temporal characteristics, target reflectivity and background environment, which results in a low peak signal-to-noise ratio (PSNR) of 3D images, ultimately affecting practical applications. To improve the PSNR of the LiRAI based on Gated3D, we propose a trilateral filter smoothing and denoising algorithm.MethodsFor the gated LiRAI, the smoothing and denoising algorithm of trilateral filter utilizes spatial and range filtering in 3D images, as well as the grayscale value filtering in gated images. The trilateral filter is explained with the Eq.(1), and the spatial, range and gray-scale filtering are shown in Eq.(2)-(5). Compared to the traditional bilateral filtering algorithm, the trilateral filtering algorithm introduces grayscale value filtering. For depth maps with high noise recovered by the gated LiRAI, the proposed algorithm can preserve the object edge information while smoothing small-scale noise, even if two objects with different reflectance are relatively close together. After smoothing noise, the depth maps are transformed to point cloud, and the statistical outlier removal (SOR) algorithm is used to remove outliers in the point cloud.Results and DiscussionsThe trilateral filter algorithm is tested on both simulated data and real-world data. In the simulation experiment, we designed a pyramid-shaped depth map to simulate the smooth regions and edge regions. The original pyramid-shaped depth maps and their depth maps with different noise are shown in Fig.3. We test bilateral filter and trilateral filter algorithms by applying them to smooth the noise in the pyramid-shaped depth maps, and the PSNR of the whole depth map as well as the edge regions of the depth map are analyzed. The results are shown (Fig.5-6, Tab.1-2). Two diffuse targets with different reflectivity are used as the real-world test data in Fig.7, and a part of the data are selected for quantitative analysis in Fig.9. The results are shown in Tab.3. In both test datasets, the trilateral filter algorithm performs better than the bilateral filter algorithm especially in the edge regions. The result of real scene by the proposed algorithm are shown in Fig.10.ConclusionsWe propose a noise smoothing algorithm of trilateral filter to smooth noise in 3D images from gated LiRAI, and further combine the SOR filter algorithm to remove outliers in point cloud. The 3D images recovered by the LiRAI based on Gated3D are affected by noise, in which case the traditional noise smoothing algorithm such as the bilateral filter is unable to smooth the noise and preserve edges. The proposed algorithm can preserve the edges when the targets have different reflectivity, and performs better than the bilateral filter algorithm on both synthetic data and real-scene data.

    Keywords
    Tools

    Get Citation

    Copy Citation Text

    Chenhao XIA, Xinwei WANG, Liang SUN, Bo SONG, Songtao FAN, Yan ZHOU. Trilateral filter smoothing and denoising algorithm for gated light ranging and imaging[J]. Infrared and Laser Engineering, 2024, 53(8): 20240204

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category:

    Received: May. 28, 2024

    Accepted: --

    Published Online: Oct. 29, 2024

    The Author Email:

    DOI:10.3788/IRLA20240204

    Topics