The Raman and infrared spectra of tellurite glasses were studied, and the influence mechanism of OH- on upconversion luminescence of Er3+-doped tellurite glasses was analyzed. The experimental results showed that the phonon energy of oxyfluoride tellurite (60TeO2-40PbF2-0.5Er2O3, TPF) glass was higher than that of oxychloride tellurite (60TeO2-40PbCl2-0.5Er2O3, TPC) glass, but upconversion luminescence intensity of Er3+-doped TPF glass was also higher than that of Er3+-doped TPC glass. It is considered in the removing water experiment that this phenomenon could be mainly attributed to the effect of OH-. With decreasing concentration of OH-, both the fluorescence lifetime and upconversion luminescence of Er3+ were enhanced. In this experiment, the effect of OH- on upconversion luminescence of Er3+ was bigger than that of phonon energy, and thus resulted in upconversion luminescence intensity of Er3+-doped TPF glass higher than that of Er3+-doped TPC glass. The research results were conducing to increase luminescence efficiency of Er3+.