This paper addressed the multi-frame super-resolution reconstruction. A novel block-based adaptive super resolution algorithm was proposed, and the size of matrixes was reduced greatly. The size of matrixes was related to the size of block, and independent of the size of sequence. Consequently, it could reduce the memory capacity, and improve the processing efficiency. Experiments showed that this algorithm did not have high requirement on the estimation precision of motion parameter. If estimation precision was low, the performance of the algorithm was better than traditional multi-frame SR algorithm. Therefore, the proposed algorithm was more appropriate for practical application.