In order to suppress the measurement error caused by environmental vibration and realize the dynamic detection of spherical optical elements, a reflective point diffraction interference system based on micro polarizer array is proposed in this work. The interference system uses a short coherent laser source to obtain two coherent beams. The contrast of interference fringes is adjusted by adjusting the light intensity ratio of two polarized beams. Four phase-shifting interferograms are obtained by a single frame image collected by a CCD camera with integrated micro polarizer array to realize dynamic detection. The measurement results of the same concave mirror sample with the interference system and ZYGO interferometer are consistent, which verifies the accuracy of the measurement results of the interference system. On the experimental measurement platform, the vibration condition of the motor is added, and the results show that when the vibration velocity is less than 16 μm/s, more accurate surface shape measurement results can be obtained, which indicates that the anti-vibration performance of the interference system is good.