Laser Doppler vibrometer (LDV) has a potential application prospect in remote sensing. Based on the correlation theories of heterodyne detection, a LDV system with a configuration of all fiber and heterodyne techniques is developed to detect the sound signal through the vibration of glass. Experimental results show that the LDV system has an ability to acquire the real-time speech signal 25 m away through glass. While, the system signal-to-noise ratio (SNR) value decreases with the increase of the glass thickness and the detection distance.