Because texture images cannot be directly processed by the gray level information of individual pixel, we propose a new texture descriptor which reflects the intensity distribution of the patch centered at each pixel. Then the general multiphase image segmentation model of Potts model is extended for texture segmentation by adding the region information of the texture descriptor. A fast numerical scheme based on the split Bregman method is designed to speed up the computational process. The algorithm is efficient, and both the texture descriptor and the characteristic functions can be implemented easily. Experiments using synthetic texture images, real natural scene images and synthetic aperture radar images are presented to give qualitative comparisons between our method and other state-of-the-art techniques. The results show that our method can accurately segment object regions and is competitive compared with other methods especially in segmenting natural images.