A new two wavelength fiber sensor for measuring surface roughness was introduced. The structure, working principle and characteristic of the fiber sensor were described. The experimental result indicates that the fiber sensor has good linearity, strong ability of antijamming, higher accuracy and usage for small surface measuring. Furthermore, error formula of the fiber sensor is induced, measuring error caused by temperature flux is numerically discussed.