1. A method for creating a novel viewpoint image from a plurality of images comprising the steps of a. Simultaneously and continuously acquiring sets of images from a plurality of cameras; and b. Using predetermined background based correspondence fields to detect novel objects; and c. Assigning the image representations for these objects likely new correspondences; and d. Testing these likely new correspondences and further improving upon them in a refinement step; and e. Using the resulting correspondences, construct a novel viewpoint image.