1. A method for tracking an object comprising the steps of: receiving a video sequence comprised of a plurality of image frames; maintaining a sample based representation of object appearance distribution; dividing an object into one or more components; for each component, estimating its location and uncertainty with respect to the sample based representation; applying Variable-Bandwidth Density Based Fusion (VBDF) to each component to determine a most dominant motion; and using the motion estimate to determine the track of the object.