The most commonly used color difference formula was analyzed，the color difference formula was applied in image main color extraction by the clustering algorithm.Theoretical analysis and experimental results show that CIE94has a better display，and more efficient.As a result，the choice of color difference formula is closely linked with the actual use.We should choose different color difference formula to achieve a different image display.