Journals Articles Conferences News About CLP
Submit a paper Email Alert
Search
Search
Articles
Journals
News
Advanced Search
Top Searches
2D MaterialsTransformation opticsQuantum PhotonicsSmall lasersSemiconductor UV PhotonicsSupersymmetric microring laser arrays

Laser & Optoelectronics Progress, Volume. 61, Issue 16, 1611016(2024)

Dynamic Panoramic Image Synthesis Technology Using Compound Eye Camera Array (Invited)

Mingzhi Cao1,2, Bowen Wang1,2, Jingya Qi3, Fujie Wu1,2, Yingjun Sang1,2, Sheng Li1,2, Lin Li3、*, Yuzhen Zhang1,2、**, Qian Chen1,2, and Chao Zuo1,2、***
Author Affiliations
  • 1Smart Computational Imaging Laboratory, School of Electronic and Optical Engineering, Nanjing University of Science & Technology, Nanjing 210094, Jiangsu, China
  • 2Jiangsu Key Laboratory of Spectral Imaging and Intelligent Sense, Nanjing 210094, Jiangsu, China
  • 3Lab of Space Optoelectronic Measurement & Intelligent Sense, Beijing Institute of Control Engineering, Beijing 100190, China
    • show less
    AbstractGet PDF(in Chinese)
    Figures&Tables (8)
    Equations (12)
    References (18)
    Cited By (4)
    Tools
    Paper Information
    Topics
    Figures & Tables(8)
    Overall flowchart of panoramic image synthesis algorithm. (a) Multi-frame images and fusion results; (b) flowchart of keyframe registration based on central processing unit and graphic processing unit; (c) flowchart of seam fusion algorithm based on visual background extractor

    Fig. 1. Overall flowchart of panoramic image synthesis algorithm. (a) Multi-frame images and fusion results; (b) flowchart of keyframe registration based on central processing unit and graphic processing unit; (c) flowchart of seam fusion algorithm based on visual background extractor

    Download full size
    Seam fusion method. (a) Image registration algorithm; (b) seam line search algorithm; (c) seam stitching algorithm based on visual background extractor; (d) seam weight fusion algorithm based on block gain exposure compensation; (e) stitch result without ghosting

    Fig. 2. Seam fusion method. (a) Image registration algorithm; (b) seam line search algorithm; (c) seam stitching algorithm based on visual background extractor; (d) seam weight fusion algorithm based on block gain exposure compensation; (e) stitch result without ghosting

    Download full size
    Multi-aperture compound eye camera array system. (a) Overall structure of system; (b) adjustment flowchart of camera position; (c) flowchart of multi-threaded image transmission

    Fig. 3. Multi-aperture compound eye camera array system. (a) Overall structure of system; (b) adjustment flowchart of camera position; (c) flowchart of multi-threaded image transmission

    Download full size
    Comparison of fusion results. (a) Results of different fusion methods; (b) static target; (c) low-speed bus; (d) high-speed car; (e) error map

    Fig. 4. Comparison of fusion results. (a) Results of different fusion methods; (b) static target; (c) low-speed bus; (d) high-speed car; (e) error map

    Download full size
    Comparison of seam line updating. (a) Multi-frame stitching results; (b) schematic of seam line based on visual background extractor; (c) updated seam line results; (d) seam line fusion results; (e) updated seam line fusion results

    Fig. 5. Comparison of seam line updating. (a) Multi-frame stitching results; (b) schematic of seam line based on visual background extractor; (c) updated seam line results; (d) seam line fusion results; (e) updated seam line fusion results

    Download full size
    Results of multi-frame stitching. (a) Multi motion target areas; (b) high speed moving target areas; (a1)‒(a3) three consecutive frames of multiple moving target images; (b1)‒(b3) three consecutive frames of high-speed moving target images; (c1)‒(c3) three consecutive frames of partial enlarged image of multiple moving objects

    Fig. 6. Results of multi-frame stitching. (a) Multi motion target areas; (b) high speed moving target areas; (a1)‒(a3) three consecutive frames of multiple moving target images; (b1)‒(b3) three consecutive frames of high-speed moving target images; (c1)‒(c3) three consecutive frames of partial enlarged image of multiple moving objects

    Download full size

    • Table 1. Registration performance comparison

      View table

      Table 1. Registration performance comparison

      Resolution /（pixel×pixel）Registration rate /%Running time /s
      Traditional methodProposed methodTraditional methodProposed method
      1920×108080.9694.120.870.21
      2560×144079.6894.081.720.25
      3840×216077.6095.003.260.37
      5780×289080.1094.286.000.64
      7680×432080.9793.938.660.85
      10240×576077.9793.8813.461.18

    • Table 2. Evaluation of splicing effect and running time

      View table

      Table 2. Evaluation of splicing effect and running time

      MethodBRISQUECEIQENIQANIQEPIQERunning time/s
      Simple weighted fusion31.632.960.412.7941.160.13
      Laplace fusion51.462.950.494.262.731.64
      Traditional seam fusion with color difference29.512.990.412.7238.720.16
      Traditional seam fusion with structural difference31.52.980.422.840.640.16
      Our fusion27.552.970.392.6936.870.05
    Tools

    Get Citation

    Copy Citation Text

    Mingzhi Cao, Bowen Wang, Jingya Qi, Fujie Wu, Yingjun Sang, Sheng Li, Lin Li, Yuzhen Zhang, Qian Chen, Chao Zuo. Dynamic Panoramic Image Synthesis Technology Using Compound Eye Camera Array (Invited)[J]. Laser & Optoelectronics Progress, 2024, 61(16): 1611016

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Set citation alerts for article
    Save article for my favorites
    Paper Information

    Category: Imaging Systems

    Received: Apr. 9, 2024

    Accepted: May. 20, 2024

    Published Online: Aug. 12, 2024

    The Author Email: Lin Li (cast_lilin@163.com), Yuzhen Zhang (479608575@qq.com), Chao Zuo (zuochao@njust.edu.cn)

    DOI:10.3788/LOP241062

    CSTR:32186.14.LOP241062

    Topics

    laser devices and laser physics
    Lasers and Laser Optics
    Laser physics
    laser manufacturing
    Instrumentation, Measurement and Metrology