In order to eliminate the problems of the silhouette and crosstalk noise in the interference-based and multiple image cryptosystems, an asymmetric optical cryptography mechanism for multiple color images based on Gyrator transform and unequal modulus vector decomposition is designed. Firstly, all color images are decomposed into three primary color components of red, green and blue. Then, each color is classified and superimposed, and fused into a three-channel form. The random phase mask is generated by Logistic mapping to modulate the superimposed color components. Secondly, the modulated image components are rotated under the Gyrator transform domain to form three complex distribution functions. Thirdly, it is decomposed into two vectors with different amplitudes and phases, the first vector is a fixed shared, and the second vector is a different decrypted. Finally, the shared vector is further applied with inverse Gyrator transform to produce the final password image. The encryption process is characterized by no contour, no crossover and high sensitivity. Experimental data show that the proposed algorithm has stronger anti-cracking ability than the existing multi-target encryption technology, which can better solve the problem of crosstalk noise.