To measure the sound field distribution accurately, a direct sound field measurement method based on a laser vibrometer is researched. Based on the fact that the air refractive index is changed periodically when the sound wave propagates in the air, the vibration velocity caused by the periodically changed refractive index occurred in laser passed through a sound field can be measured by the laser vibrometer. As the projection of the sound field in the direction of the laser is the vibration velocity, the direct measurement of sound field can be completed by measuring the projection of the sound field in different directions and reconstructing the complex amplitude distribution of the sound field using inverse Radon transform. The amplitude distribution and phase distribution of the vibration velocity caused by a 2 kHz sound field are measured experimentally, and the sound pressure amplitude distribution and the instantaneous sound pressure distribution are reconstructed. The measurement shows that the spatial resolution is 2 cm, the measured maximum sound pressure amplitude is 0.026 Pa, and corresponding sound pressure level is 62.3 dB. Experimental results indicate that the direct sound field measurement based on the laser vibrometer is feasible, and it solves the problem existing in the sound field measurement by using microphone arrays.