1. A method for automatically editing a video data sequence to generate a video summary, the method comprising: extracting sub-shots from the video data sequence; calculating importance measures for at least a portion of the sub-shots; identifying particular ones of the portion that have relatively higher importance measures as compared to importance measures of other sub-shots; determining a relative distribution of each sub-shot in the particular ones; based on relative distributions of each sub-shot of the particular ones, dropping sub-shots from the particular ones that do not have a uniform distribution with respect to other sub-shots in the particular ones; and connecting remaining sub-shots in the particular ones with respective shot transitions to generate the video summary.