Low temperature plasma produced by dielectric barrier discharge (DBD) is widely used in plasma medicine, environmental governance and other fields. The common driving source is high voltage pulse power supply. A rectangular pulse power supply based on Marx circuit is designed. The power supply combines the magnetic ring isolation drive scheme with the full-bridge Marx circuit to realize the output of positive, negative and bipolar high voltage rectangular pulses, which solves the limitation that the conventional pulse power supply can only output specific polarity pulses. The operation mode of the circuit is analyzed theoretically and the experimental prototype is built. Under no-load conditions, the pulse polarity can be adjusted and the amplitude of 10 kV high voltage pulse output is realized. The parallel plate dielectric barrier discharge reactor was successfully driven by the pulse power supply, which further verified the feasibility of the scheme.