1. A method of operating a video processing system, comprising: identifying a first trajectory associated with an object in video captured of a first region; identifying a plurality of alternative views of the object from the video of the first region; and using the plurality of alternative views of the object, selecting a second trajectory that corresponds to the first trajectory from a plurality of trajectories associated with a plurality of objects in video captured of a second region; wherein a video processing system maintains a threshold value of change that information in a view of the object should surpass in order for that view to not be discarded by the video processing system because it provides redundant information.