1. A computer-implemented motion estimation device for predicting a vector by referring to motion vectors of adjacent blocks, the device comprising: a processor; and a memory storing instructions to be executed by the processor by causing the processor to execute: a plurality of motion estimating units which perform parallel processing for processing object blocks, in which each neighboring processing object block forms a line, wherein: each of the plurality of motion estimating units comprises: a pseudo predicted motion vector calculating unit for calculating a pseudo predicted motion vector of a corresponding processing object block using motion vectors of a reference block set to which processing has ended; and a motion vector searching unit for searching and outputting a motion vector of the corresponding processing object block using the calculated pseudo predicted motion vector; and a motion vector buffer for storing motion vectors outputted from the motion vector searching unit in each of the plurality of motion estimating units, wherein the pseudo predicted motion vector calculating unit calculates the pseudo predicted motion vector using motion vectors of the reference block set stored in the motion vector buffer which includes at least one block in each of block positions of x, x−s, x+t, y, and y−u (wherein s, t and u are positive integers) to a processing object block position (x,y), and when each of the neighboring processing object blocks forms an oblique line, the pseudo predicted motion vector calculating unit calculates the pseudo predicted motion vector using the motion vectors of the reference block set which includes blocks in positions of (x −1,y), (x,y−1) and (x+1,y−2) to the processing object block position (x,y).