In the optical manufacture process, the material removal in the rough grinding and fine grinding stage is the largest, while it is rather small in the polishing stage. Therefore, if the rough and fine grinding surface is measured in the whole field, the machining process will be greatly shortened. Among the existing measurement methods, CMM (the coordinate measuring machine) and infrared interferometer are expensive or inefficient. In this paper, a binocular structured light 3D measurement is used in the optical manufacture process to realize a non-contact, full field, fast and high-precision measurement of dynomizing optical elements. The experimental results prove its feasibility and the measurement error is less than 10 um. There is a great significant application value for the rapid and accurate measurement of cutting amount in the optical manufacture process.