1. A method for determining a similarity between a first and a second frame in an input video sequence comprising a plurality of frames, said method comprising: calculating a refined feature space representation of said input video sequence to generate a plurality of refined frames; using said calculated refined feature space representation to compute said similarity between said first and said second frame; and grouping said plurality of refined frames including the first and the second frame into a plurality of video shots, wherein the grouping is determined using a minimum threshold for frame inclusion, a maximum threshold for frame exclusion, and a threshold range from the minimum threshold to the maximum threshold, for which threshold range further analysis is performed, wherein the refined feature space representation is a matrix, wherein each column of said matrix represents a frame in a refined feature space corresponding to a frame in said plurality of frames.