Opto-Electronic Engineering, Volume. 51, Issue 10, 240166(2024)

Unsupervised light field depth estimation based on sub-light field occlusion fusion

Haoyu Li1... Yeyao Chen1, Zhidi Jiang2, Gangyi Jiang1 and Mei Yu1,* |Show fewer author(s)
Author Affiliations
  • 1Faculty of Information Science and Engineering,Ningbo University,Ningbo,Zhejiang 315211,China
  • 2College Science & Technology,Ningbo University,Ningbo,Zhejiang 315300,China
  • show less

    Light field depth estimation is an important scientific problem of light field processing and applications. However,the existing studies ignore the geometric occlusion relationship among views in the light field. By analyzing the occlusion among different views,an unsupervised light field depth estimation method based on sub-light field occlusion fusion is proposed. The proposed method first adopts an effective sub-light field division mechanism to consider the depth relationship at different angular positions. Specifically,the views on the primary and secondary diagonals of the light field sub-aperture arrays are divided into four sub-light fields,i.e.,top-left,top-right,bottom-left,and bottom-right. Then,a spatial pyramid pooling feature extraction and a U-Net network are leveraged to estimate the depths of the sub-light fields. Finally,an occlusion fusion strategy is designed to fuse all sub-light field depths to obtain the final depth. This strategy assigns greater weights to the sub-light field depth with higher accuracy in the occlusion region,thus reducing the occlusion effect. In addition,a weighted spatial and an angular consistency loss are employed to constrain network training and enhance robustness. Experimental results demonstrate that the proposed method exhibits favorable performance in both quantitative metrics and qualitative comparisons.

    Keywords
    Tools

    Get Citation

    Copy Citation Text

    Haoyu Li, Yeyao Chen, Zhidi Jiang, Gangyi Jiang, Mei Yu. Unsupervised light field depth estimation based on sub-light field occlusion fusion[J]. Opto-Electronic Engineering, 2024, 51(10): 240166

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Article

    Received: Jul. 15, 2024

    Accepted: Sep. 10, 2024

    Published Online: Jan. 2, 2025

    The Author Email: Yu Mei (郁梅)

    DOI:10.12086/oee.2024.240166

    Topics