In order to improve the naturalness of interaction, an interaction method that uses finger detected by special orthogonal binocular cameras as an input of interactive system to guide holographic images display is proposed. After analyzing finger movement and images changes, an interaction relationship between them is established. For realizing the interaction, the digital hologram sequences should be acquired beforehand through computergenerated holograms, then the relevant holograms should be selected to reconstruct images according to finger information detected by cameras, eventually, the interaction between finger and optelectronic reconstructed real images of digital hologram can be achieved. The proposed method is validated by an interaction between peacock images and people.