Vision chip is a high-speed, low-power intelligent vision processing system on a chip (SoC), it can be applied to many different fields of production and daily life. A new programmable vision chip architecture was proposed which took into account the computational features of traditional computer vision algorithms and convolutional neural networks, it enabled the architecture to support the two types of algorithms simultaneously. The vision chip integrated multi-level parallel programmable processing array, high-speed data transmission path and system control module, it was fabricated in a 65 nm standard CMOS process. The experimental results show that the vision chip achieves 413GOPS peak performance at 200 MHz system clock and can perform various computer vision and artificial intelligence algorithms including face recognition and target detection efficiently. The proposed work shows higher system performance in terms of programmability, performance and energy efficiency when compared with other state-of-the-art vision chips.