Banyan network shows promising characteristics in the practical application of optical information systems and optical interconnection networks. The properties and the connection relationships of banyan network are investigated in detail,and its topological schematic diagram is also proposed. By a cascade of the banyan network and the inverse banyan network,a full-permutation non-blocking double banyan network can be constructed. Based on the identical polarization controling technology and the same spatial structure,the node switch and the routing stage are discussed and designed by using phase spatial light modulator (PSLM),polarizing beam-splitter (PBS),and mirror. The module designed here has a number of advantages:less optical components,compact in structure,efficient in performance,bidirectional operation,and insensitive to the polarization of signal beam. The tested parameters for the 2×2 optical switch show that the full-permutation non-blocking double banyan network proposed here should be helpful in the design of large-scale optical interconnection network because of low insertion loss,low crosstalk,and high-performance.