1. An information processing apparatus comprising: an input unit configured to input moving image data that includes a plurality of frame images arranged in a time series; a detecting unit configured to detect a frame image, which includes an image similar to a prescribed subject pattern, from moving image data that has been input; a tracking unit configured to detect a frame image, which includes an image similar to the image included in the frame image detected by said detecting unit, detection being performed by adopting frame images before and after the detected frame image as a target; a storage unit configured to store, as a subject sequence, successive frame images that have been detected by said tracking unit, the successive images being stored in association with time information in the moving image data corresponding to the subject sequence; a splitting unit configured to split the moving image data into subject intervals, each of which includes one or more subject sequences and non-subject intervals, each of which includes no subject sequences; and a first extracting unit configured to extract, from each of the subject intervals, a first representative frame image using a first evaluation rule; and a second extracting unit configured to extract, from each of the non-subject intervals, a second representative frame image using a second evaluation rule which is different from the first evaluation rule.