Computer holography is a prominent technique for reconstructing customized three-dimensional (3D) diffraction fields. However, the quality of optical reconstruction remains a fundamental challenge in 3D computer holography, especially for the 3D diffraction fields with physically continuous and extensive depth range. Here, we propose a 3D computer-generated hologram (CGH) optimization framework with phase space tailoring. Based on phase space analysis of the space and frequency properties in both lateral and axial directions, the intensity of the 3D diffraction field is adequately sampled across a large depth range. This sampling ensures the reconstructed intensity distribution to be comprehensively constrained with physical consistency. A physics-informed loss function is constructed based on the phase space tailoring to optimize the CGH with suppression of vortex stagnation. Numerical and optical experiments demonstrate the proposed method significantly enhances the 3D optical reconstructions with suppressed speckle noise across a continuous and extensive depth range.