An experiment of adaptive polarization mode dispersion (PMD) compensation for 40-Gb/s return-to-zero (RZ) optical communication system is reported. In the experiment, degree of polarization (DOP) is used as feedback signal and particle swarm optimization (PSO) method is adopted as logic control algorithm. The compensation time is about 200 ms, the compensated differential group delay (DGD) is up to 30 ps, and bit error rate (BER) of 10^(-9) is reached when PMD compensation is employed.