1. An information processing apparatus comprising: an input unit configured to input moving image data that includes a plurality of frame images arranged in a time series; a detecting unit configured to detect a frame image, which includes at least one object, from the moving image data that has been input; a tracking unit configured to track, for each of the at least one object, a frame image, which includes an object similar to the object included in the frame image detected by said detecting unit, from frame images after the detected frame image; a storage unit configured to decide upon successive frame images, which have been tracked by said tracking unit, as an image sequence and to store the image sequence in association with starting time and end time thereof, where a plurality of image sequences corresponding to different objects can be overlapped with each other along a time axis; a splitting unit configured to split the moving image data into a plurality of time intervals by splitting the moving image data at the respective starting time and end time of the plurality of image sequences that have been stored in said storage unit, so that each point at which a configuration of objects is changed in the moving image data is a splitting point; an extracting unit configured to extract a candidate of a representative frame image from each of the plurality of time intervals obtained by the splitting unit; and a selection unit configured to select a representative frame image from the candidates of the representative frame image, wherein when (a) a plurality of image sequences corresponding to different objects overlap each other along the time axis and (b) there is a candidate of the representative frame image extracted from a time interval which is common to the plurality of overlapped image sequences, said selection unit selects the candidate of the representative frame image extracted from the time interval which is common to the plurality of overlapped image sequences as the representative frame image.