The vehicle type recognition algorithm which combines local binary pattern (LBP) and Hu matrix feature is proposed. LBP feature can describe the local texture of vehicle. Hu matrix features are global features, and can reflect the shape contour information of the vehicle. The recognition algorithm of the fusion of LBP and Hu matrix can describe the vehicle type characteristics. The vehicle recognition system is constructed by using the proposed fusion feature extraction method and the support vector machine classifier. The fusion algorithm achieves better performance than the single feature algorithm, and improves the vehicles recognition rate.