1. A method of generating depth information for an object in a scene using two or more array cameras that each include a plurality of imagers where each imager captures an image of the scene, the method comprising: obtaining a first set of image data comprising image data of a scene captured from a first set of different viewpoints; identifying an object of interest in the first set of image data; determining a first depth measurement for the object of interest using at least a portion of the first set of image data; determining whether the first depth measurement for the object of interest is above a predetermined threshold; and when the depth for the object of interest is above the predetermined threshold: obtaining a second set of image data comprising image data of the same scene from a second set of different viewpoints located known distances from at least one viewpoint in the first set of different viewpoints; identifying the object of interest in the second set of image data; and determining a second depth measurement for the object of interest using at least a portion of the first set of image data and at least a portion of the second set of image data.