Laser & Optoelectronics Progress, Volume. 61, Issue 12, 1215004(2024)

LiDAR and Camera External Parameter Calibration Method Based on Multi-Dimensional Dynamic Convolution

Saisai Zhang and Hongfei Yu*
Author Affiliations
  • School of Artificial Intelligence and Software, Liaoning Petrochemical University, Fushun 113000, Liaoning , China
  • show less

    The rapid development of autonomous driving necessitates precise multisensor data fusion to accurately perceive the surrounding vehicular environment. Central to this is the precise calibration of LiDAR and camera systems, which forms the basis for effective data integration. Traditional neural networks, used for image feature extraction, often yield incomplete or inaccurate results, thereby undermining the calibration accuracy of LiDAR and camera parameters. Addressing this challenge, we propose a novel method hinged on multidimensional dynamic convolution for the extrinsic calibration of LiDAR and camera systems. Initially, data undergoes random transformations as a preprocessing step, followed by feature extraction through a specialized network based on multidimensional dynamic convolution. This network outputs rotation and translation vectors through feature aggregation mechanism. To guide the learning process, geometric and transformation supervisions are employed. Experimental validation suggests an enhancement in feature extraction capabilities of the neural network, leading to improved extrinsic calibration accuracy. Notably, our method exhibits a 0.7 cm reduction in the average error of translation prediction compared with the leading alternative approaches, substantiating the efficacy of the proposed calibration method.

    Keywords
    Tools

    Get Citation

    Copy Citation Text

    Saisai Zhang, Hongfei Yu. LiDAR and Camera External Parameter Calibration Method Based on Multi-Dimensional Dynamic Convolution[J]. Laser & Optoelectronics Progress, 2024, 61(12): 1215004

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Machine Vision

    Received: Jun. 26, 2023

    Accepted: Sep. 8, 2023

    Published Online: Jun. 5, 2024

    The Author Email: Yu Hongfei (yuhfln@163.com)

    DOI:10.3788/LOP231601

    CSTR:32186.14.LOP231601

    Topics