To satisfy time-sensitivity of inshore infrared target segmentation, we improved SBGFRLS segmentation model by analyzing the features of inshore infrared image. First, visual attention model based on phase spectrum is used to replace the locating method of original contour of SBGFRLS model which decreased segmentation field and iterations. Second, the peak values of grey level histogram of inshore infrared image are used to replace the parameters of SBGFRLS model which saved calculation time. Our experiments prove that the improved algorithm is feasible and greatly improves the speed of segmentation compared with SBGFRLS model and other common segmentation method.