Computer Engineering, Volume. 51, Issue 8, 95(2025)

Acceleration Approach for Neural Radiance Field in Dynamic 3D Human Reconstruction

XIAO Yilong1, DENG Yiqin2, and CHEN Zhigang1、*
Author Affiliations
  • 1School of Computer Science and Engineering, Central South University, Changsha 410083, Hunan, China
  • 2School of Control Science and Engineering, Shandong University, Jinan 250061, Shandong, China
  • show less
    References(28)

    [1] [1] CHEN L, PENG S D, ZHOU X W. Towards efficient and photorealistic 3D human reconstruction: a brief survey[J]. Visual Informatics, 2021, 5(4): 11-19.

    [5] [5] MILDENHALL B, SRINIVASAN P P, TANCIK M, et al. NeRF: representing scenes as neural radiance fields for view synthesis[C]//Proceedings of ECCV 2020. Berlin, Germany: Springer International Publishing, 2020: 405-421.

    [6] [6] REBAIN D, JIANG W, YAZDANI S, et al. DeRF: decomposed radiance fields[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Nashville, USA: IEEE Press, 2021: 14153-14161.

    [7] [7] MLLER T, EVANS A, SCHIED C, et al. Instant neural graphics primitives with a multiresolution hash encoding[J]. ACM Transactions on Graphics, 2022, 41(4): 1-15.

    [8] [8] GARBIN S J, KOWALSKI M, JOHNSON M, et al. FastNeRF: high-fidelity neural rendering at 200FPS[C]//Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV). Montreal, Canada: IEEE Press, 2021: 14346-14355.

    [10] [10] PENG S D, ZHANG Y Q, XU Y H, et al. Neural Body: implicit neural representations with structured latent codes for novel view synthesis of dynamic humans[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Nashville, USA: IEEE Press, 2021: 9054-9063.

    [11] [11] LOPER M, MAHMOOD N, ROMERO J, et al. SMPL: a skinned multi-person linear model[J]. ACM Transactions on Graphics, 2015, 34(6): 851-866.

    [12] [12] WENG C Y, CURLESS B, SRINIVASAN P P, et al. HumanNeRF: free-viewpoint rendering of moving people from monocular video[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). New Orleans, USA: IEEE Press, 2022: 16210-16220.

    [13] [13] HE K M, GKIOXARI G, DOLLAR P, et al. Mask R-CNN[C]//Proceedings of the IEEE International Conference on Computer Vision (ICCV). Venice, Itlay: IEEE Press, 2017: 2961-2969.

    [14] [14] CHU L T, LIU Y, WU Z W, et al. PP-HumanSeg: connectivity-aware portrait segmentation with a large-scale teleconferencing video dataset[C]//Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision Workshops (WACVW). Waikoloa, USA: IEEE Press, 2022: 202-209.

    [15] [15] CHEN G W, LIU Y, WANG J, et al. PP-Matting: high-accuracy natural image matting[EB/OL]. [2024-01-27]. https://arxiv.org/abs/2204.09433v1.

    [16] [16] PUMAROLA A, CORONA E, PONS-MOLL G, et al. D-NeRF: neural radiance fields for dynamic scenes[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Nashville, USA: IEEE Press, 2021: 10318-10327.

    [17] [17] PARK K, SINHA U, HEDMAN P, et al. HyperNeRF: a higher-dimensional representation for topologically varying neural radiance fields[J]. ACM Transactions on Graphics (TOG), 2021, 40(6): 1-12.

    [18] [18] XU H, ALLDIECK T, SMINCHISESCU C. H-NeRF: neural radiance fields for rendering and temporal reconstruction of humans in motion[J]. Advances in Neural Information Processing Systems, 2021, 34: 14955-14966.

    [19] [19] SU S Y, YU F, ZOLLHFER M, et al. A-NeRF: articulated neural radiance fields for learning human shape, appearance, and pose[J]. Advances in Neural Information Processing Systems, 2021, 34: 12278-12291.

    [20] [20] YU Z M, CHENG W, LIU X, et al. MonoHuman: animatable human neural field from monocular video[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Vancouver, Canada: IEEE Press, 2023: 16943-16953.

    [22] [22] DREBIN R A, CARPENTER L, HANRAHAN P. Volume rendering[J]. ACM SIGGRAPH Computer Graphics, 1988, 22(4): 65-74.

    [23] [23] TANCIK M, SRINIVASAN P P, MILDENHALL B, et al. Fourier features let networks learn high frequency functions in low dimensional domains[J]. Advances in Neural Information Processing Systems, 2020, 33: 7537-7547.

    [24] [24] SITZMANN V, MARTEL J N P, BERGMAN A W, et al. Implicit neural representations with periodic activation functions[J]. Advances in Neural Information Processing Systems, 2020, 33: 7462-7473.

    [25] [25] LOMBARDI S, SIMON T, SARAGIH J, et al. Neural volumes[J]. ACM Transactions on Graphics, 2019, 38(4): 1-14.

    [26] [26] JACOBSON A, GINGOLD Y. Skinning: real-time shape deformation[C]//Proceedings of the SIGGRAPH Asia 2014 Courses. New York, USA: ACM Press, 2014: 19.

    [27] [27] JERUZALSKI T, LEVIN D I W, JACOBSON A, et al. NiLBS: neural inverse linear blend skinning[EB/OL]. [2024-01-27]. https://arxiv.org/abs/2004.05980v1.

    [28] [28] WENG C Y, CURLESS B, KEMELMACHER-SHLIZERMAN I. Vid2Actor: free-viewpoint animatable person synthesis from video in the wild[EB/OL]. [2024-01-27]. https://arxiv.org/abs/2012.12884v1.

    [29] [29] PHARR M, JAKOB W, HUMPHREYS G. Physically based rendering: from theory to implementation[M]. Francisco, USA: Morgan Kaufmann Publishers Inc., 2016.

    [30] [30] ZHANG R, ISOLA P, EFROS A A, et al. The unreasonable effectiveness of deep features as a perceptual metric[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Salt Lake City, USA: IEEE Press, 2018: 586-595.

    [31] [31] PECH-PACHECO J L, CRISTOBAL G, CHAMORRO-MARTINEZ J, et al. Diatom autofocusing in brightfield microscopy: a comparative study[C]//Proceedings of the 15th International Conference on Pattern Recognition. Washington D.C., USA: IEEE Press, 2000: 314-317.

    [32] [32] ALLDIECK T, MAGNOR M, XU W P, et al. Video based reconstruction of 3D people models[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Salt Lake City, USA: IEEE Press, 2018: 8387-8397.

    [33] [33] ZHAO F Q, YANG W, ZHANG J K, et al. HumanNeRF: efficiently generated human radiance field from sparse inputs[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). New Orleans, USA: IEEE Press, 2022: 7743-7753.

    Tools

    Get Citation

    Copy Citation Text

    XIAO Yilong, DENG Yiqin, CHEN Zhigang. Acceleration Approach for Neural Radiance Field in Dynamic 3D Human Reconstruction[J]. Computer Engineering, 2025, 51(8): 95

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category:

    Received: Jan. 29, 2024

    Accepted: Aug. 26, 2025

    Published Online: Aug. 26, 2025

    The Author Email: CHEN Zhigang (czg@csu.edu.cn)

    DOI:10.19678/j.issn.1000-3428.0069317

    Topics