Realizing effective and efficient object detection plays an important role in computer vision and has many practical applications including video surveillance and auto navigation. In order to improve the speed and accuracy of the existing detection methods, a simple yet effective object detection method coupled objectness estimation with Hough forest was proposed. Firstly, objectness estimation was utilized to generalize a set of object proposals based on bottom up visual attention mechanism of human vision system. Secondly, Hough forest object was adopted to localize the center of the object in the region of interest which was confirmed by object proposals put forward in the last step. Thirdly, the scale of the object proposal where the center was located was employed to determine the size of the object. A set of experiments demonstrate the effectiveness and efficiency of the proposed method.