In order to provide a robust scene matching algorithm with the scale and rotation invariance and less influence by different illumination under complex conditions,this paper researches scene matching techniques based on key lines.Inspired by the Human Visual System (HVS),a new scene matching method based on key lines is put forward by using a set of filters that are the same processing models as the human cortex filter.The mathod uses the vectors to describe key lines to implement the metching between the two images and is characterized by less numbers of key line and great information as compared with that of a point matching method.It introduces the extraction,expression and matching lines and gives the simulation results and matching properties.Experiment results show that the proposed method works well for the condition of rotating and scaling,and can offer the precision of scene matching of 1 pixel,which meets the requirements of high stability and good robust for complex background scene matching.