1. A frame interpolation device comprising: a block division unit configured to divide a first reference frame of a moving image signal and a second reference frame temporally preceding the first reference frame into predetermined block units; a motion vector detection unit configured to detect a plurality of motion vectors in block units on the basis of the correlation between respective blocks of the first and second reference frames divided by the block division unit; a candidate vector extraction unit configured to calculate the statistical amount of the plurality of motion vectors detected by the motion vector detection unit, and obtain at least first and second motion vectors from the statistical amount; a block motion estimation unit configured to estimate the first or second motion vector for each of the blocks on the basis of the first and second motion vectors obtained by the candidate vector extraction unit; a generated pixel motion estimation unit configured to translate the first and second motion vectors to pass through the position of a generated pixel in an interpolated frame provided between the first and second reference frames, set local areas at four points of the start points and the end points of the translated first and second motion vectors to be search areas, and identify from the search areas the first or second motion vector estimated by the block motion estimation unit; and a frame interpolation unit configured to perform motion compensation on the generated pixel by using the first or second motion vector identified by the generated pixel motion estimation unit.