Acta Optica Sinica, Volume. 44, Issue 7, 0733001(2024)
Dynamic Three-Dimensional Reconstruction of Soft Tissue in Neural Radiation Field for Robotic Surgery Simulators
Fig. 1. Schematic of optically based reproduction of color information of soft tissues
Fig. 3. Reconstruct the endoscopic surgery scene into a composite radiation field, and use the SASM to divide the endoscopic surgery scene into three regions: dynamic region, static region, and deformable region
Fig. 5. By promoting a more concentrated density distribution along each camera ray in the static component, the recovered background contains more highlights to enhance the realism of the image
Fig. 8. Results of each soft tissue reconstruction in the endoscopic scenario of robotic surgery simulation (qualitative)
Fig. 9. Line graphs of color difference of each organ. (a) Lung color difference line graph; (b) kidney color difference line graph; (c) liver color difference line graph
Fig. 10. Different color difference representations indicate that the color of the reconstructed organ is close to the true color of biological soft tissue. (a) Photographed original kidney map; (b) 3D scatter plot of positional color difference; (c) contour map of magnification chromatic aberration; (d) 3D reconstructed kidney map; (e) vector chromatic aberration map in color coded map of R channel; (f) vector chromatic aberration map in color coded map of G channel
Fig. 11. Performance of reconstructed biological soft tissue improves over time (represented by increasing number of iterations)
Fig. 12. Influence of hyperparameters (the number of input images) on reconstruction performance. (a) PSNR; (b) SSIM; (c) MSSIM
Fig. 13. Influence of hyperparameters (number of hidden layers, regularization weights) in hash grids on reconstruction quality. (a) PSNR; (b) MAE; (c) NRMSE
|
Get Citation
Copy Citation Text
Qi Chen, Zhibao Qin, Xiaoyu Cai, Shijie Li, Zijun Wang, Junsheng Shi, Yonghang Tai. Dynamic Three-Dimensional Reconstruction of Soft Tissue in Neural Radiation Field for Robotic Surgery Simulators[J]. Acta Optica Sinica, 2024, 44(7): 0733001
Category: Vision, Color, and Visual Optics
Received: Sep. 8, 2023
Accepted: Jan. 10, 2024
Published Online: Apr. 11, 2024
The Author Email: Shi Junsheng (taiyonghang@126.com), Tai Yonghang (taiyonghang@126.com)
CSTR:32393.14.AOS231537