Fluctuating polarization state-of-light in the optical loop is an important factor that seriously influences the output performance of a multi-carrier source based on re-circulating frequency shifter (RFS). The reason for output spectrum instability when no polarization controller (PC) is present in the loop is analyzed theoretically. Numerical simulations for the output spectra of the multi-carrier source with and without PC are conducted, and the trajectories of the several frequency components polarization states on the Poincare sphere with and without PC are compared. The results show that the performance of multi-carrier source based on a RFS can be improved effectively by adjusting the PC in the configuration properly.