1. A time segment representative feature vector generation device, comprising: an intra-time segment feature vector group selection unit that selects, for each time segment and from a feature vector series for respective frames, feature vectors of a plurality of frames included in a time segment; and a dimension selection unit that sequentially selects, for each time segment and from the selected feature vectors of different frames in the time segment, features of different dimensions of the feature vectors in accordance with predetermined degrees of importance of respective dimensions of the feature vectors starting from a dimension having a highest degree of importance, and generates a time segment representative feature vector which is a feature vector representing the time segment.