1. A method for determining an alpha matte for a video acquired of a scene, comprising the steps of: selecting a foreground depth plane from a set of videos acquired by an array of cameras, there being one video acquired by each camera, and each video including a sequence of images, and each image including pixels, and a centrally located camera being designated as a reference camera configured to acquire a designated reference video; determining a trimap from variances of intensities of pixels in each image, the trimap including pixels labeled as foreground, pixels labeled as background, and pixels labeled as unknown; extrapolating variances of the intensities of pixels labeled as background and the pixels labeled as foreground to the pixels labeled as unknown; and extrapolating means of the intensities of the pixels labeled as background to the pixels labeled as unknown to determine an alpha matte for the reference video.