In the traditional calibration method, the in-phase quadrature(IQ) modulator has the problems of slow calibration speed and the data is complex and difficult to process. In some practical applications, it is impossible to provide quadrature radio frequency signals with an amplitude of twice the half-wave voltage. In order to solve these problems, a rapid fine calibration method based on modulation phase for IQ modulator is proposed, which can achieve fast and accurate calibration of IQ modulator bias voltage without adding radio frequency. The test results show that this method can complete the calibration of IQ modulator in about 45 s, and the calibration accuracy is high, and the resolution is 10 mV. The IQ modulator can be directly controlled to generate single sideband signal with suppressed carrier.