1. A prediction vector generation device configured to generate a prediction vector of a disparity vector of a target block in a non-base viewpoint image, the prediction vector generation device comprising: a disparity vector conversion unit configured to calculate a representative value using depth values of pixel positions at four corners of a block corresponding to the target block in a depth map corresponding to the non-base viewpoint image and convert the representative value into a disparity vector; and a prediction vector determination unit configured to generate the prediction vector of the disparity vector of the target block by using the disparity vector generated by the disparity vector conversion unit.