1. A method for summarizing a video sequence comprising the steps of: decomposing a video sequence into a series of component scenes; merging component scene pairs until a predetermined number of scene sets remain; extracting a keyframe from each scene set containing a single component scene; and constructing a new keyframe for each scene set containing a plurality of component scenes.