Traditional speckle fringe patterns by electronic speckle pattern interferometry (ESPI) are inherently noisy and of limited visibility, so denoising is the key problem in ESPI. We present the variational denoising method for ESPI. This method transforms the image denosing to minimizing an appropriate penalized energy function and solving a partial differential equation. We test the proposed method on computer-simulated and experimental speckle correlation fringes, respectively. The results show that this technique is capable of significantly improving the quality of fringe patterns. It works well as a pre-processing for the fringe patterns by ESPI.