1. A method of annotating each video segment in a plurality of video segments with an indicator of the likelihood that the respective video segment shows a particular feature, the plurality of video segments forming an episode of interest from a given video domain, the method comprising the steps of: determining initial feature probabilities for respective ones of the plurality of video segments using a machine learning algorithm, each initial feature probability indicating the likelihood that its respective video segment shows the particular feature; determining refined feature probabilities for respective ones of the plurality of video segments, the refined feature probabilities determined by finding the most probable state sequence in a finite state machine, the most probable state sequence determined at least in part using the calculated initial feature probabilities; and annotating each of the video segments in the plurality of video segments with its respective refined feature probability.