1. A video scene classification device which assigns an index to one or more pictures among pictures which compose a video, the video scene classification device comprising: a video sampling unit operable to obtain pictures which are part of the pictures which compose the video, by sampling; a processing area determining unit operable to determine, for each of the pictures obtained by the video sampling unit, an area on which image processing is performed; a picture classifying unit operable to perform the image processing on the area of each of the pictures determined by the processing area determining unit to calculate a classification indicator which is used as an indicator for clustering, and classify the part of the pictures into clusters based on the classification indicator, the classification indicator including a feature of the part of the pictures; a cluster selecting unit operable to select at least one cluster among the clusters classified by the picture classifying unit; an indexing rule selecting unit operable to select an indexing rule based on one of the classification indicator and program content information of the video, the indexing rule being a rule for assigning an index to the part of the pictures; and an index generating unit operable to assign the index to at least one picture among the pictures which compose the selected cluster, using the selected indexing rule, wherein, based on the program content information, the indexing rule selecting unit is operable to select one of: (1) assigning the index to at least the one or more pictures included in the selected cluster; (2) sorting the at least one picture included in the selected cluster according to a time axis, and assign the index to every picture group within a predetermined time period; and (3) assigning the index to a video block, among video blocks included in a predetermined cluster, which has not been included in a continuous group due to another predetermined cluster.