1. A system for processing video data, the system comprising: a logic circuit configured to process a series of sequentially-ordered video frames in a set of video data, by defining a region of interest in an initial one of the video frames, generating a particle mesh from a set of feature points for an object in the defined region, propagating the particle mesh to an adjacent video frame using motion vectors of points in the mesh to determine a coarse boundary at the adjacent frame, detecting a condition of occlusion and scene boundaries in the adjacent video frame based upon the position of the determined coarse boundary, and using the detected condition of occlusion and scene boundaries to set a boundary and a number of feature points within the coarse boundary in the adjacent video frame, to maintain mesh coherence and track the object in the adjacent video frame.