Video summarization is an effective way to quickly obtain the key information of video.Existing video summarization methods usually have high computational complexity and are difficult to be applied in the scene with limited computing resources.Therefore,a spatiotemporal joint method for surveillance video summarization via the direction information is proposed.This method first uses the horizontal slice to obtain the object spatiotemporal motion trajectory.Secondly,the spatiotemporal trajectory background is eliminated and the linear trajectory slope is calculated,and the object motion direction is determined according to the object spatiotemporal trajectory slope. Thirdly,the motion segment in the sampling domain is detected to determine the timing position of the object in the video.Finally,the video summarization is constructed adaptively according to the object timing position and motion direction.Experimental results show that the average frame processing time (AFPT) of the proposed method reaches 0.374 s,which has obvious advantages over those of the comparison methods.In addition,the generated video summarization is concise and efficient,and the user experience is good.