Denoising is the key problem in electronic speckle pattern interferometry. The total variation image denoising algorithm for Electronic Speckle Pattern Interferometry Fringe (ESPI) is proposed and the fidelity coefficient is improved. First, the energy function of the image is defined by total variation model, and then the optimal solution of this energy function is obtained by variation method. The method transforms the image denoising processing into solving a partial differential equation. The proposed method was tested on computer-simulated and experimental speckle fringe patterns, respectively. Both qualitative and quantitative results show that this technique is capable of not only significantly filtering but also preserving fringe contrast.