In the existing structured-light vision measurement systems, the camera and the projector are installed inside a glass tube to cover the omnidirectional field of view, inevitably causing the refraction distortion. To address the distortion mentioned above, the refraction on two cylindrical interfaces is analyzed and the distortion caused by two non-coplanar refraction planes is investigated. A general distortion correction model of omnidirectional structured-light vision measurement is established. An aluminum tube with an internal diameter of 288.50 mm is measured by the omnidirectional structured-light vision measurement system and the internal diameter of this aluminum tube is calculated based on the proposed general distortion correction model. The experimental results indicate that the repeatability and precision reach 0.047 mm and 0.23 mm, respectively. The measurement system is stable and reliable, and the proposed general distortion correction model of omnidirectional structured-light vision measurement is highly accurate.