Light field image can simultaneously record light intensity and direction information in the scene, but it requires more storage and transmission resources, so that efficient encoding schemes are required. This paper proposes a light field image coding method based on human visual system, achieving end-to-end perceptual light field coding. Considering that under the same distortion level of light field encoding, the distortion in salient region is more easily perceived, a light field image perception coding method is proposed. Aiming at the perception redundancy of sub aperture images, considering that the Just Noticeable Distortion (JND) model in pixel domain does not pay attention to the salient region characteristics, a JND masking model combining saliency is constructed; and then, adaptive rate allocation considering human perception is performed for each sub aperture image frame. The experimental results show that in the low latency mode, compared with the High Efficiency Video Coding (HEVC) encoder, the proposed method saved an average bit rate of 16.01% under the same quality index of Significance Weighted Peak Signal-to-Noise Ratio (SW-PSNR), it improves the efficiency of light field image encoding while achieving a higher degree of fit with the subjective perception of the human eye.