In order to reduce the phase error caused by the nonlinear response of digital projectors in three-dimensional measurement system of grating projection, a multi-frequency fringe inverse-phase error compensation method is proposed for improving the accuracy and speed of the object phase measurement. By projecting the compensated phase-shifted fringe pattern with the same maximum phase frequency and the same phase shift, the two phased phase diagrams with the same phase error and opposite signs are obtained. After the operation, their errors are canceled and compared with the multi-frequency method to get the exact absolute phase value. A standard plane is used for verifying the proposed method, the comparisons are done with recently proposed Hilbert transform compensation method and classical phase compensation method. The experiments results show that the proposed method can improve the accuracy and speed of phase measurement effectively. The feasibility and validity of the proposed method is verified by phase error compensation for a free form surface and object of discontinuous surface.