A technique for compensation of temperature effects in fiber grating sensors is reported. For strain sensors and other sensors related to strain such as electromagnetic sensors, a novel structure is designed, which uses two fiber Bragg gratings (FBGs) as strain differential sensor and has temperature effects cancelled. Using this technique, the stress sensitivity has been amplified and gets up to 0.226 nm/N, the total variation in wavelength difference within the range of 3-45 oC is 0.03 nm, 1/14 of the uncompensated FBG. The structure can be used in the temperature-insensitive static strain measurement and minor-vibration measurement.