Developing some thermal insulating composite materials based on perlite is a subject to expand the application of mineral materials. In this paper, the vinyl silicone oil or room-temperature vulcanized silicone rubber was mixed with two kinds of perlite with different sizes and fumed silica as fillers through a kneading process and a direct mixing process, respectively. Some composite silicone rubber insulation boards were prepared and evaluated by the thermal conductivity and insulation performance. The results show that the product prepared by the kneading process has resulted in a reduced heat preservation ability of perlite, probably due to the broken hollow particles. The insulation board prepared with fumed silica as a main filler is difficult to form their shape, and the minimum thermal conductivity is 0.172 8 W·m-1·K-1 for the formed sample. When a mass ratio of perlite and fumed silica in silicone rubber is 37.5% and the product thickness is 2.5 cm, the minimum thermal conductivity is 0.034 9 W·m-1·K-1, and the back-side temperature is 67 ℃ after heating at 250 ℃ for 4 min, which basically meets the application requirements of thermal insulation materials for tobacco facility.