1. An information processing apparatus comprising: a detection unit adapted to detect a face region and an eye region of an object from an obtained image of the object; a generation unit adapted to generate normalized images of a high-resolution image and low-resolution image from the obtained image of the face region based on a positional relationship between the face region and the eye region in the image; a first extraction unit adapted to extract a first feature amount indicating a direction of a face existing in the face region from the low-resolution image; a feature point detection unit adapted to detect a position of a feature point indicating the eye region in the normalized image of the high-resolution image; a clipping unit adapted to clip the eye region in the normalized image of the high-resolution image based on the position of the feature point detected by said feature point detection unit; an enlargement/reduction unit adapted to enlarge or reduce the eye region clipped by said clipping unit to make the eye region have a predetermined size; a second extraction unit adapted to extract a second feature amount indicating a direction of an eye existing in the eye region from the eye region having the predetermined size which is enlarged or reduced by said enlargement/reduction unit; and an estimation unit adapted to estimate a gaze direction of the object from the first feature amount and the second feature amount.