1. A method for automatically producing a summary of a video, comprising: partitioning a video into scenes using a frame-similarity matrix, each element in the frame-similarity matrix representing a distance between feature vectors of a corresponding pair of frames; generating a scene-similarity matrix comprising a plurality of elements based on the frame-similarity matrix, each element of the scene-similarity matrix representing a measure of similarity between different scenes of the video; determining, by a processor, an importance score for each scene based on the scene-similarity matrix, the importance score for a scene indicating a relative importance of the scene and wherein the importance score is increased responsive to the scene having a high similarity with other scenes in the video; selecting representative scenes from the video based on the determined importance scores; and combining selected scenes to produce the summary for the video.