Acta Optica Sinica, Volume. 39, Issue 2, 0215005(2019)

Observation System of Special Vehicle Based on Perspective Display

Xiaodong Jiang1、*, Jiyan Yu1、*, Jiansen Huang2, and Likun Zhu3
Author Affiliations
  • 1 Minsterial Key Laboratory of ZNDY, Nanjing University of Science and Technology, Nanjing, Jiangsu 210094, China
  • 2 School of Science, Nanjing University of Science and Technology, Nanjing, Jiangsu 210094, China
  • 3 CETHIK Group Institute, CETHIK Group Co. Ltd., Hangzhou, Zhejiang 310012, China
  • show less
    Figures & Tables(22)
    Working principle of PSD sensor
    Relations of transformation in coordinate system
    Relation of inertial attitude sensing axis
    Structure of outboard observation system based on visual display
    Design of PSD signal processing circuit
    Flow of complementary fusion filtering algorithm for helmet attitude angle
    Helmet perspective solution principle
    Design diagram of optical system for perspective display
    Schematic of ZEMAX's equivalent optical design
    Effect of distortion correction. (a) Image before distortion correction; (b) image after distortion correction
    Overall structure diagram of hardware acceleration process of image feature calculation and registration based on Zynq SoC processor
    Hardware circuit implementation of Gaussian filtering. (a) Hardware circuit structure; (b) window function of Gaussian filter
    Original image and effect of Gaussian filtering image. (a) Original image; (b) image filtered by Gaussian filter
    Schematic diagram of Gaussian scale pyramid and differential Gaussian pyramid
    Schematic of hardware circuit for parallel detection
    Effect of image feature points and direction determination. (a) Original image; (b) characteristic image
    Flow chart of hardware realization for electronic image stabilization based on image features
    Flow chart of hardware realization for image registration and fusion processing
    Experimental results of hardware realization for image feature matching and fusion. (a) Left image; (b) right image; (c) schematic diagram of image feature matching and fusion
    • Table 1. Experimental results of position detection, attitude sensing and perspective

      View table

      Table 1. Experimental results of position detection, attitude sensing and perspective

      NumberPreset viewMeasure viewError analysis
      Direction angle /(°)Pitch angle /(°)Direction angle /(°)Pitch angle /(°)Direction angle error /(°)Pitch angle error /(°)
      10.0-35.00.5-34.60.50.4
      245.0-10.045.1-10.40.10.4
      360.0+15.059.6+14.90.40.1
      490.0+27.089.7+27.80.30.8
      5120.0+12.0119.8+12.30.20.3
      6330.0-21.0330.4-21.70.40.7
      7315.0-16.0314.8-16.90.20.9
      8300.0+23.0300.4+23.60.40.6
      9270.0+19.0270.6-19.70.60.7
      10240.0+3.0230.9+3.80.90.8
    • Table 2. Experiment results of image feature extraction and time-consuming comparison

      View table

      Table 2. Experiment results of image feature extraction and time-consuming comparison

      NumberPC with opencv 2.4.10Zynq SoCCharacteristic overlap /%
      Number of feature pointsTime consuming /msNumber of feature pointsTime consuming /ms
      15961268.55693.691.68
      27691568.77305.690.65
      34391139.44163.292.34
    • Table 3. Experimental results of electronic image stabilization

      View table

      Table 3. Experimental results of electronic image stabilization

      Image typeFeature matching rate of adjacent images≥50% /%Feature matching rate of adjacent images<50% /%
      With electronic image stabilization80.3419.66
      Original image56.3943.61
    Tools

    Get Citation

    Copy Citation Text

    Xiaodong Jiang, Jiyan Yu, Jiansen Huang, Likun Zhu. Observation System of Special Vehicle Based on Perspective Display[J]. Acta Optica Sinica, 2019, 39(2): 0215005

    Download Citation

    EndNote(RIS)BibTexPlain Text
    Save article for my favorites
    Paper Information

    Category: Machine Vision

    Received: Jul. 30, 2018

    Accepted: Sep. 25, 2018

    Published Online: May. 10, 2019

    The Author Email:

    DOI:10.3788/AOS201939.0215005

    Topics