1. An image recognition apparatus for recognizing an object by using encode information at one of image encoding and image decoding based on a motion-compensating prediction and a discrete cosine transform, the apparatus comprising: an evaluation value calculation unit for calculating multiple kinds of evaluation values based on the encodes information; and a determination unit for, according to a determination rule that defines relationships between (a) multiple objects that are to be extracted from an, input image and (b) the multiple evaluation values that are calculated by the evaluation value calculation unit, determining, for each of the multiple pixel blocks, which one of multiple pixel blocks corresponds to which one of the multiple objects, wherein the evaluation value calculation unit at least uses, as the encode information, a two dimensional DCT coefficient derived from the discrete cosine transform.