Laser & Optoelectronics Progress, Volume. 61, Issue 4, 0400004(2024)

Vision-Based Optical 3D Reconstruction and the Application in Crop Information Perception

Shengqi Yu, Dong Hu*, and Wei Liu**
Author Affiliations
  • College of Optical, Mechanical and Electrical Engineering, Zhejiang A&F University, Hangzhou 311300, Zhejiang , China
  • show less
    References(66)

    [1] Hartley Z K J, Jackson A S, Pound M et al. GANana: unsupervised domain adaptation for volumetric regression of fruit[J]. Plant Phenomics, 2021, 9874597(2021).

    [2] Wang R C, Zhang L, Zhang T et al. Application research of vision-based 3D reconstruction technology in military field[J]. China Computer & Communication, 33, 13-16(2021).

    [3] Wang Siqi, Zhang Jiaqiang, Li Liyuan, Li Xiaoyan, Chen Fansheng. Application of MVSNet in 3D reconstruction of space objects[J]. Chinese Journal of Lasers, 49, 2310003(2022).

    [4] Zheng T X, Huang S, Li Y F et al. Key techniques for vision based 3D reconstruction: a review[J]. Acta Automatica Sinica, 46, 631-652(2020).

    [5] Bao Y, Tang L, Srinivasan S et al. Field-based architectural traits characterisation of maize plant using time-of-flight 3D imaging[J]. Biosystems Engineering, 178, 86-101(2019).

    [6] Fahlgren N, Gehan M A, LightsBaxter I., camera, action. high-throughput plant phenotyping is ready for a close-up[J]. Current Opinion in Plant Biology, 24, 93-99(2015).

    [7] Teng J J, Hu C Y, Huang H H et al. Single-shot 3D tracking based on polarization multiplexed Fourier-phase camera[J]. Photonics Research, 9, 1924-1930(2021).

    [8] Chen J J. 3D reconstruction technology of the metal object based on fringe projection[D], 15-17(2011).

    [9] Chen R, Xu H L, Yang D X et al. Dense three-dimensional reconstruction algorithm based on spatially encoded structured light[J]. Journal of Xidian University, 48, 123-130(2021).

    [10] Deng S C, Chen Y H, Huang Y et al. Research on improved phase based on structured light 3D reconstruction system[J]. Modular Machine Tool & Automatic Manufacturing Technique, 31-34, 38(2021).

    [11] Xue F, Chen L, Zhang F F. Research on 3D reconstruction of strongly reflected surface based on structured light[J]. Journal of Harbin University of Science and Technology, 26, 18-24(2021).

    [12] Zhou P, Zhu J P, Kong L Y et al. Three-dimension face acquisition with rotating speckle structured light projection[J]. Laser & Optoelectronics Progress, 58, 0415019(2021).

    [13] Zuo C, Zhang X L, Hu Y et al. Has 3D finally come of age?: an introduction to 3D structured-light sensor[J]. Infrared and Laser Engineering, 49, 0303001(2020).

    [14] Liu F, Luo H F, Jiang H L et al. Modified three-dimensional reconstruction based on three-frequency three-step phase shifting algorithm[J]. Infrared and Laser Engineering, 51, 20210179(2022).

    [15] Liu F, Yan M Y, Li X et al. Advances in diffused polarization-based three-dimensional imaging technology[J]. Laser & Optoelectronics Progress, 58, 1811015(2021).

    [16] Liu J H, Wang Y Z. 3D surface reconstruction of small height object based on thin structured light scanning[J]. Micron, 143, 103022(2021).

    [17] Yang S C, Huang H L, Wu G X et al. High-speed three-dimensional shape measurement with inner shifting-phase fringe projection profilometry[J]. Chinese Optics Letters, 20, 112601(2022).

    [18] Savarese S, Andreetto M, Rushmeier H et al. 3D reconstruction by shadow carving: theory and practical evaluation[J]. International Journal of Computer Vision, 71, 305-336(2007).

    [19] Yang X P, Wang L, Zhai H C. A shadow Moire system based on two Ronchi gratings structure for the measurement of 3D profile[J]. Journal of Optoelectronics·Laser, 13, 1155-1158(2002).

    [20] Du H B, Zhang S F, Yu J H et al. Research on random phase shifting shadow Moiré technique[J]. Acta Optica Sinica, 38, 0815010(2018).

    [21] Dorrington A A, Kelly C B D, Mcclure S H et al. Advantages of 3D time-of-flight range imaging cameras in machine vision applications[C], 95-99(2009).

    [22] Druml N, Ehrenhoefer C, Bell W et al. A fast and flexible HW/SW co-processing framework for time-of-flight 3D imaging[J]. Microelectronics Reliability, 81, 64-76(2018).

    [23] Ganapathi V, Plagemann C, Koller D et al. Real time motion capture using a single time-of-flight camera[C], 755-762(2010).

    [24] Li Z L, Zhou K, Mu Q et al. TOF camera real-time high precision depth error compensation method[J]. Infrared and Laser Engineering, 48, 1213004(2019).

    [25] Lou L. Research on data reduction algorithm of three-dimensional laser scanning point cloud[D], 20-24(2017).

    [26] Disney M. Terrestrial LiDAR: a three-dimensional revolution in how we look at trees[J]. The New Phytologist, 222, 1736-1741(2019).

    [27] Mozerov M G, van de Weijer J. Accurate stereo matching by two-step energy minimization[J]. IEEE Transactions on Image Processing, 24, 1153-1163(2015).

    [28] Navarro J, Buades A. Semi-dense and robust image registration by shift adapted weighted aggregation and variational completion[J]. Image and Vision Computing, 89, 258-275(2019).

    [29] Niu Z G, Li L J, Wang T. 3D reconstruction based on binocular stereo vision of robot[J]. Advanced Materials Research, 338, 645-648(2011).

    [30] Mao J H, Lou X P, Li W X et al. Binocular 3D volume measurement system based on line-structured light[J]. Optical Technique, 42, 10-15(2016).

    [31] Zhang R R, Ge G Y, Shen Z et al. 3D reconstruction based on binocular stereo vision[J]. Journal of Yangzhou University (Natural Science Edition), 21, 5-10(2018).

    [32] Gao Z R, Su Y, Zhang Q C. Single-event-camera-based 3D trajectory measurement method for high-speed moving targets[J]. Chinese Optics Letters, 20, 061101(2022).

    [33] Yin Y, Zhang H C, Zheng J Q. Three dimensional reconstruction system of plant based on binocular stereo vision[J]. Journal of Chinese Agricultural Mechanization, 42, 129-135(2021).

    [34] Liu Q S, Xie X F, Zhang X Z et al. Equivalent multi-camera model of focused plenoptic camera and its application in structure from motion[J]. Acta Optica Sinica, 41, 0315001(2021).

    [35] Chen P, Ren J J, Wang H X et al. Equal-scale structure from motion method based on deep learning[J]. Opto-Electronic Engineering, 46, 190006(2019).

    [36] Han C. SfM algorithm of 3D reconstruction from UAV aerial images[D], 16-18(2019).

    [37] Wu C C. Towards linear-time incremental structure from motion[C], 127-134(2013).

    [38] Cui H N, Shen S H, Gao W et al. Efficient large-scale structure from motion by fusing auxiliary imaging information[J]. IEEE Transactions on Image Processing, 24, 3561-3573(2015).

    [39] Wang Q L, Xu Z B, Zhang L. Application and research development of 3D reconstruction based on structure from motion[J]. Wool Textile Journal, 49, 95-98(2021).

    [40] Han D, Yang G J, Yang H et al. Three dimensional information extraction from maize tassel based on stereoscopic vision[J]. Transactions of the Chinese Society of Agricultural Engineering, 34, 166-173(2018).

    [41] Yang M L, Zheng J L, Yu L P et al. Preparation and luminescent properties of Sr2MgAl22O36∶Mn4+ phosphor-in-glass for plant growth LED[J]. Chinese Journal of Luminescence, 42, 717-723(2021).

    [42] Li Y D, Xu X K, Li W et al. Progress of carbon dots regulating plant photosynthesis[J]. Chinese Journal of Luminescence, 42, 1172-1181(2021).

    [43] Zhou J J. Research on 3D reconstruction technology of maize plants based on multi-view images[D], 23-17(2019).

    [44] Zhang Y, Teng P, Shimizu Y et al. Estimating 3D leaf and stem shape of nursery paprika plants by a novel multi-camera photography system[J]. Sensors, 16, 874(2016).

    [45] Martinez-Guanter J, Ribeiro Á, Peteinatos G G et al. Low-cost three-dimensional modeling of crop plants[J]. Sensors, 19, 2883(2019).

    [46] Liang X Y, Zhou F R, Chen H et al. Three-dimensional maize plants reconstruction and traits extraction based on structure from motion[J]. Transactions of the Chinese Society for Agricultural Machinery, 51, 209-219(2020).

    [47] Li Y C, Liu J Y, Zhang B et al. Three-dimensional reconstruction and phenotype measurement of maize seedlings based on multi-view image sequences[J]. Frontiers in Plant Science, 13, 974339(2022).

    [48] Schöler F, Steinhage V. Automated 3D reconstruction of grape cluster architecture from sensor data for efficient phenotyping[J]. Computers and Electronics in Agriculture, 114, 163-177(2015).

    [49] Hui F, Zhu J Y, Hu P C et al. Image-based dynamic quantification and high-accuracy 3D evaluation of canopy structure of plant populations[J]. Annals of Botany, 121, 1079-1088(2018).

    [50] Ma X D, Zhu K X, Guan H O et al. Calculation method for phenotypic traits based on the 3D reconstruction of maize canopies[J]. Sensors, 19, 1201(2019).

    [51] Ge L Z, Yang Z L, Sun Z et al. A method for broccoli seedling recognition in natural environment based on binocular stereo vision and Gaussian mixture model[J]. Sensors, 19, 1132(2019).

    [52] Wu S, Wen W L, Wang Y J et al. MVS-pheno: a portable and low-cost phenotyping platform for maize shoots using multiview stereo 3D reconstruction[J]. Plant Phenomics, 2020, 1848437(2020).

    [53] Yang T T, Ye J H, Zhou S Y et al. 3D reconstruction method for tree seedlings based on point cloud self-registration[J]. Computers and Electronics in Agriculture, 200, 107210(2022).

    [54] Yang H J, Wang R P, Wang Z Y et al. Three-dimensional phenotypic reconstruction of crop fruit based on multi-view image[J]. Journal of Nanjing Normal University (Natural Science Edition), 44, 92-103(2021).

    [55] Zhang Y, Zhai F Q, Cai S B et al. Feature extraction and 3D reconstruction of plant leaf based on point cloud data[J]. China Measurement & Test, 47, 6-12(2021).

    [56] Hu Y, Wang L, Xiang L R et al. Automatic non-destructive growth measurement of leafy vegetables based on kinect[J]. Sensors, 18, 806(2018).

    [57] Paturkar A, Gupta G S, Bailey D. Non-destructive and cost-effective 3D plant growth monitoring system in outdoor conditions[J]. Multimedia Tools and Applications, 79, 34955-34971(2020).

    [58] Li W, Zhu D L, Wang Q. A single view leaf reconstruction method based on the fusion of ResNet and differentiable render in plant growth digital twin system[J]. Computers and Electronics in Agriculture, 193, 106712(2022).

    [59] Lu Y Z, Lu R F. Structured-illumination reflectance imaging coupled with phase analysis techniques for surface profiling of apples[J]. Journal of Food Engineering, 232, 11-20(2018).

    [60] Cai Z Y, Jin C Q, Xu J et al. Measurement of potato volume with laser triangulation and three-dimensional reconstruction[J]. IEEE Access, 8, 176565-176574(2020).

    [61] Ma H, Zhu X, Ji J T et al. Rapid estimation of apple phenotypic parameters based on 3D reconstruction[J]. International Journal of Agricultural and Biological Engineering, 14, 180-188(2021).

    [62] Peng Y P, Yang M B, Zhao G P et al. Binocular-vision-based structure from motion for 3-D reconstruction of plants[J]. IEEE Geoscience and Remote Sensing Letters, 19, 1-5(2022).

    [63] Lati R N, Filin S, Eizenberg H. Estimating plant growth parameters using an energy minimization-based stereovision model[J]. Computers and Electronics in Agriculture, 98, 260-271(2013).

    [64] Chen Y, Zhang B H, Zhou J et al. Real-time 3D unstructured environment reconstruction utilizing VR and Kinect-based immersive teleoperation for agricultural field robots[J]. Computers and Electronics in Agriculture, 175, 105579(2020).

    [65] Wang Y J, Wen W L, Wu S et al. Maize plant phenotyping: comparing 3D laser scanning, multi-view stereo reconstruction, and 3D digitizing estimates[J]. Remote Sensing, 11, 63(2018).

    [66] Rose J C, Paulus S, Kuhlmann H. Accuracy analysis of a multi-view stereo approach for phenotyping of tomato plants at the organ level[J]. Sensors, 15, 9651-9665(2015).

    Tools

    Get Citation

    Copy Citation Text

    Shengqi Yu, Dong Hu, Wei Liu. Vision-Based Optical 3D Reconstruction and the Application in Crop Information Perception[J]. Laser & Optoelectronics Progress, 2024, 61(4): 0400004

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Reviews

    Received: Dec. 27, 2022

    Accepted: Feb. 22, 2023

    Published Online: Feb. 22, 2024

    The Author Email: Hu Dong (20180047@zafu.edu.cn), Liu Wei (liuwei@zafu.edu.cn)

    DOI:10.3788/LOP223410

    Topics