In direct phase measuring deflectometric systems， the unique structure of liquid crystal displays （LCDs） and transparent displays （TDs） induces light refraction during measurements， resulting in phase deviations. This study presents a method to compensate for the refractive errors of these displays. By modeling the two displays as a single transparent layered structure， a ray tracing algorithm is employed to establish refraction error models throughout the measurement process. The light propagation paths are analyzed to identify the parameters necessary for correcting phase deviations. Subsequently， multi-stereo vision technology， combined with an optimized three-domain reflection algorithm， is utilized to calibrate the refraction parameters of the displays. Based on a geometric analysis of the system， the refraction angle during measurement is calibrated. Finally， an error compensation formula is derived and applied to correct the depth values pixel by pixel， enhancing measurement accuracy. Experimental results demonstrate that the proposed compensation method reduces the maximum absolute error between the mirror ring and the stepped surface from 33 µm to 21 µm， and decreases the root mean square error （RMSE） of the combined mirror assembly， comprising a concave and a plane mirror， from 38.55 µm to 24.92 µm. These improvements correspond to an overall enhancement of measurement accuracy by 30% to 40%. The method effectively mitigates refraction errors in the two displays and significantly improves the three-dimensional measurement precision of the system.