An interaction device that enables an operator to interact with different gestures in a VR (Virtual Reality) system is presented. The joint angles of the individual fingers are measured with fiber optic sensors and the relative position and orientation of the palm are tracked with alternating current pulsed magnetic tracker. The algorithm to calculate the spherical coordinates from the output of the accelerometers and magnetoresistive sensors is deducted. The relationship between the output of the fiber optic sensor and the actual flexure angle is studied. Experiment result shows the effectiveness of the proposed device.