The traditional image quality assessment algorithm can not meet the actual requirement since the visual information and the essential features of the image are not taken into consideration. We studied the image edge information extraction and singular value decomposition method, and proposed a new method for objective quality assessment, which can give consideration to both of the information. The singular value information of the image shows the essential information of image and human eyes are sensitive to the edge information of image. Theoretically, the algorithm of image quality assessment based on edge information and singular value decomposition is better than traditional methods. The simulation experiment results show that: compared with the tradition methods of SSIM, MSE and PSNR, the proposed algorithm is more consistent with human visual system, and has better correspondence between subjectivity and objectivity.