1. A method of operating a video processing system, comprising: identifying a first trajectory associated with an object in video captured of a first region; identifying a plurality of alternative views of the object from the video of the first region; generating additional views for inclusion in the plurality of alternative views by copying and horizontally flipping at least one view of the plurality of alternative views; and using the plurality of alternative views of the object, selecting a second trajectory that corresponds to the first trajectory from a plurality of trajectories associated with a plurality of objects in video captured of a second region, wherein identifying the first trajectory comprises: determining a set of descriptor vectors for the object, wherein each descriptor vector is computed for an image region containing the object in each frame of the video; determining a parameterized group of transformations associated with each image region; and determining a map from at least a portion of the parameterized group of transformations to the set of descriptor vectors.