1. An image processing apparatus comprising: a block division unit that divides at least one image frame out of a plurality of image frames constituting moving image information into a plurality of blocks; a motion vector calculation unit that tracks each of the blocks that are obtained by the block division unit, in one of two image frames before and after the one image frame, and calculates respective motion vectors for each of the blocks; a motion vector selection unit which selects an evaluation target motion vector from among the motion vectors calculated by the motion vector calculation unit; a block identification unit which sets, as comparison target motion vectors, motion vectors corresponding to blocks which are outside a predetermined radial physical distance from a block corresponding to the evaluation target motion vector; and a global motion vector determining unit that determines a global motion vector of the one image frame based on a comparison of the evaluation target motion vectors, wherein the global motion vector determining unit operates a plurality of times with respect to a plurality of different evaluation target motion vectors, judges whether each of the evaluation target motion vectors satisfies a condition based on results of the comparisons, and determines the global motion vector of the one image frame based on results of the judging.