1. A method for tracking a target object in sequential frames of images containing the target object, the method comprising: determining a target image depicting a first tracking position associated with a target object in one frame of an image sequence; generating, by a processor, a plurality of sample windows about the first tracking position of the target object by using sliding windows; classifying, by the processor, image targets in sliding windows by Gaussian Kernel Regularized least Square; collecting all sub-windows; computing sub-window scores; creating, by the processor, a negative sample set; creating two weight graphs of a template and target candidates with node links; calculating, by the processor, a distance metric fusion by cross diffusion; and tracking an object to the sequential frames of images using a collaborative distance metric.