1. A method for determining a similarity between a first and a second frame in an input video sequence, said method comprising: (a) calculating a refined feature space representation of said input video sequence; (b) using said calculated representation to compute said similarity between said first and said second frames.