Xinjiang-25 cm telescope is a small aperture sky survey telescope used to support geostationary earth orbit(GEO) target monitoring tasks. Space object monitoring must rely on fast optical image processing technology and astronomical positioning method to obtain the right ascension and declination measurement information of space objects. The Xinjiang-25 cm telescope has a large pointing error, which significantly affects the success rate of optical image processing. In this study, we analyze the impact of pointing error on star map recognition in astronomical positioning and propose an improved fast star map recognition method based on pointing search that can automatically adapt to the adverse impact of pointing error. This method was tested using the image of the 25-cm telescope at Nanshan station, Xinjiang, and the expected effect was achieved, proving its effectiveness and stability.