Depth information can be acquired via different kinds of methods, like stereo vision, time-of-flight imaging and structured light. But all those three-dimensional (3D) imaging techniques have limitations in practical applications. Polarization is a significant property for light wave which can provide additional detailed information. Applying the polarization characteristics to 3D imaging, namely polarization-based 3D imaging, can make up for the shortcomings of existing 3D imaging methods to a certain extent. The research progress in polarization-based 3D imaging is overviewed based on the various methods of depth measurements and the implementation of polarization character, including polarized stereo vision, polarized time-of-flight imaging and polarized structured light. The advantages and shortcomings of the polarization-based approach are analyzed and summarized, which provides guidance for future research directions in related fields.