1. A method for tracking a pill in a patient's hand, comprising: performing a foreground detection process to determine a hand-pill-hand region; performing image segmentation to separate the determined hand portion of the hand-pill-hand region from the pill portion thereof; building three reference models, one for each hand region and one for the pill region; initializing a dynamic model for tracking the hand-pill-hand region; determining N possible next positions for the hand-pill-hand region; for each such determined position, determining various features to be employed in a comparison to a reference model; building a new model for that region in accordance with the determined position; for each position, comparing the new model and the reference model; determining a position whose new model generates a highest similarity score; determining whether that similarity score is greater than a predetermined threshold; wherein if it is determined that the similarity score is greater than the predetermined threshold, the object is tracked.