Aiming at the difficulty of feature point matching in infrared and visible image registrationan infrared and visible image registration method based on NSCT contour extraction and main direction consistency matching is proposed.FirstlyNSCT transform is used to extract the contour curves of infrared and visible imagesand the corners on the contour curves are extracted as feature points by using CSS corner detection algorithm.Thenthe middle line of the contour curve is used as the main direction of the feature pointsand the SIFT descriptor of the main direction of the feature points on the infrared and visible images is calculated as the feature description of the feature points.Finallythe mismatched points are removed by using the method of main direction consistency matching of the feature pointsand the affine transformation parameters are calculated.Experimental results show thatthe average Root Mean Square Error (RMSE) of the proposed method is 2.36and the average Correct Matching Ratio (CMR) reaches 91.6%which ensures the accuracy of extracting and matching the same feature points on two kinds of images and improves the accuracy of image registration.