In order to solve the problem of poor target localization accuracy in a large field of view fisheye imaging system, a research method based on camera movement to calibrate the imaging model of the fisheye imaging system was adopted. The calibration object was a single fixed point light source, and the fisheye imaging system was driven to move by a motorized high-precision 2-D turntable to record the orientation angle of the point light source in the fisheye imaging system and the pixel position of the light point in the image, respectively, to construct a calibration model of the fisheye imaging system so that the point light source was imaged at each position in the image; the optical center was calculated by using the edge-fitting circle of the effective area of the image, and the aberration parameters were calculated by using the sub-regional calibration method to reduce the calibration error. The results show that when divided into three regions for calibration, the calibration error of the method in the central imaging region is 0.06°. This method has a high accuracy and can be applied to the calibration of large field-of-view fisheye imaging systems such as infrared earth sensors and wide-angle imaging reconnaissance systems.