1. A method performed by at least one processing unit of a computer system, the method comprising: determining a corresponding block pair for a first image corresponding to a first viewpoint of a scene and a second image corresponding to a second viewpoint of the scene, wherein the first image comprises multiple first blocks and the second image comprises multiple second blocks and the corresponding block pair comprises an individual first block from the first image and an individual second block in the second image that both correspond to a particular portion of the scene; projecting the individual first block and the individual second block of the corresponding block pair to obtain a corresponding projection position for a third image corresponding to a third viewpoint of the scene; and using the corresponding projection position to determine a predicted disparity vector for an individual third block of the third image that also corresponds to the particular portion of the scene.