1. An object recognition apparatus comprising: a clipping-out unit configured to sequentially clip out partial images from an input image; a recognizing unit configured to recognize that each of the partial images clipped out by the clipping-out unit is or is not an image related to an object by referring to each of a plurality of recognition information items stored in advance in a storage unit for recognizing the object; and a determining unit configured to determine, based on a recognition result of the recognizing unit for a certain partial image, an order in which the recognizing unit refers to each of the plurality of recognition information items for a partial image in the neighborhood of the certain partial image.