A new observation system of special vehicle based on perspective display is proposed. The hardware scale-invariant feature transform (SIFT) algorithm is achieved based on the Zynq SoC processor, and the video images corresponding to perspective are spliced in real time. At the same time, a fast electronic image stabilization algorithm based on image features is proposed for the fluctuation of driver's perspective. The experimental results show that the perspective decoding error is less than 1°, the electronic image stabilization algorithm can reduce the image shaking effectively, and the hardware SIFT algorithm can speed up the processing time of image feature calculation to the order of millisecond.