An approach for capture and display three-dimensional real scene with video speed was proposed. A real-time three-dimensional imaging system using fringe projection was designed. And a real-time color holographic display system using liquid crystal spatial light modulator was designed. Two fringe patterns with phase shift π and an encoding pattern were adopted in 3D imaging system. Absolute phase was obtained and isolated objects could be measured. A high speed projector was obtained by modifying a projector using digital micromirror device. Three-dimensional capture with video speed was realized by combining the modified projector and high speed camera. The color image and range image of three-dimensional scene was captured with the proposed three-dimensional imaging system. Then, Fresnel holograms were produced with these three-dimensional data. Finally, color threedimensional images were reconstructed with proposed display system. The speed of capture and display reaches 60 fps.