A novel method to fabricate optical matrix switch based on polarization is presented, by controlling polarization states of signal beams to obtain non blocking cross connect. The detailed implementation of the node switches and the switching network are given. A 4×4 optical matrix switch fabricated with this method is tested, and the experiment result demonstrates that it characterizes by low insertion loss, low cross talk, medium switching speed (ms), performance stability and technology maturity, which is quite suitable for small sized optical matrix switch.