1. A computer-implemented method for tracking one or more objects in a sequence of images, the method comprising: generating, by a computer, a dictionary based on object locations in a first image included in the sequence of images; identifying, by the computer, one or more object landmark candidates in the sequence of images; generating, by the computer, a plurality of tracking hypothesis for the object landmark candidates; and selecting, by the computer, a first tracking hypothesis from the plurality of tracking hypothesis based on the dictionary.