1. A method for tracking a three-dimensional pose based on video captured in a distributed aperture having a multi-camera configuration, comprising the steps of: generating a plurality of pose hypotheses in each camera of said multi-camera configuration; transferring said plurality of pose hypotheses generated in each camera to all cameras in said multi-camera configuration; scoring each of said plurality of pose hypotheses generated in and transferred to each camera; determining a cumulative score for each of said plurality of pose hypotheses generated in and transferred to each camera; discarding least scoring pose hypotheses in each camera; and executing a pose refinement on a best scoring pose hypothesis remaining in each camera.