The asymmetry of the signal is one important character of the self mixing interference effect, which leads to the possibility of directional discrimination in the Doppler velocity measurment or displacement measurment. Theoretical models are given by using a two mirror cavity model, which explains the asymmetry of the self mixing interference signal successfully. Simulation results are given which are consistent with the experimental ones.