1. A computer-implemented method for tracking an object in a frame of a video, comprising: (a) receiving a region of a previous frame, the region having been previously identified as including the object; (b) determining a plurality of candidate regions based on the region; for respective candidate regions in the plurality of candidate regions: (c) determining a degree of similarity of content of the frame located at the respective candidate region with at least one composite image from a plurality of composite images, each composite image in the plurality of composite images representing a generalized model of the object with a different pose; (d) determining a recognition score using an adaptive recognition model trained, at least in part using content of the region of the previous frame, to recognize the object, the recognition score indicating a likelihood that the respective candidate region of the frame includes the object; (e) determining whether the object has moved to the respective candidate region in the frame of the video based, at least in part, on the degree of similarity and the recognition score; and (f) training the adaptive recognition model using the content of a candidate region of the image determined to include the object, whereby the determining with the at least one composite image in (c) reduces drift when the adaptive recognition model is trained in (f).