To explore the scattering characteristics of the stray light on hood surface of a camera, the Bidirectional Reflectance Distribution Function(BRDF) of the matte coating(Z306) on a aluminium plate specimen was measured and modeled to suppress the stray light. The BRDF value of the specimen coated with matte coating Z306 at 0.65 μm was obtained. On the basis of the scattering characteristics of the specimen coated with matte coating Z306, the microfacet-based model suitable for roughness matte coating was selected and corrected. The corrected microfacet-based model was used to model and process the measurement data and to obtain the BRDF data of the specimen in the whole hemisphere space to make up the defects of the less data and measurement errors. The BRDF data of the matte coating was induced to the software to analyze the stray light of an optical system and to compare the performance with the results of the stray light measurement. It shows that after the measurement data are processed by the correction microfacet-based model, the analysis results of the stray light have high consistency with the measurement results of the stray light, and the logarithm value of the ratio of tested value and analyzed value is less than 0.5. The results demonstrate that the BRDF model is necessary and the data processing is accurate, which provides an important method for stray light suppression in optical systems.