Infrared and Laser Engineering, Volume. 50, Issue 11, 20210021(2021)

Light field depth estimation of fusing consistency and difference constraints

Zeyang He1...2, Huiping Deng1,2, Sen Xiang1,2, and Jin Wu12 |Show fewer author(s)
Author Affiliations
  • 1School of Information Science and Engineering, Wuhan University of Science and Technology, Wuhan 430081, China
  • 2Engineering Research Center for Metallurgical Automation and Measurement Technology of Ministry of Education, Wuhan University of Science and Technology, Wuhan 430081, China
  • show less

    Light field image depth estimation is a critical technique in applications such as light field 3D reconstruction, target detection and tracking. The refocusing property of light field image provided rich information for depth estimation, however it was still challenging in the case of occlusion region, edge region, noise interference, etc. Therefore, a depth estimation algorithm based on the consistency of epipolar plane image (EPI) slant pixels and the difference of epipolar plane image regions was proposed to solve the occlusion and noise problems. The consistency of EPI slant pixels was adopted by the spinning linear operator (SLO) color entropy metric, which could improve the accuracy of depth map edges as well as the noise immunity; the difference of EPI regions was measured by the chi-square χ2 metric of the spinning parallelogram operator (SPO), which could improve the accuracy of the depth gradient area of the depth map,and the two metrics were fused with confidence weighting, which could reduce the interference of occluded regions and noise. In addition, the color similarity of the pixel neighborhood was fully utilized, and post-processing was performed with a guided edge-preserving filter and Markov random field (MRF) global optimization strategy to further reduce the edge error of the depth map to obtain an accurate depth map with occluded edges. Experiments were conducted on the HCI light field data set and compared with the classic light field depth estimation algorithm. The results show that the algorithm has a significant improvement in both subjective quality and objective indicators.;that the proposed method outperformed state-of-the-art depth estimation methods. Compared with the classical light field depth estimation algorithm, proposed method had significant improvement on both subjective and objective qualities.

    Tools

    Get Citation

    Copy Citation Text

    Zeyang He, Huiping Deng, Sen Xiang, Jin Wu. Light field depth estimation of fusing consistency and difference constraints[J]. Infrared and Laser Engineering, 2021, 50(11): 20210021

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Image processing

    Received: May. 25, 2021

    Accepted: --

    Published Online: Dec. 7, 2021

    The Author Email:

    DOI:10.3788/IRLA20210021

    Topics