1. A method for decoding compressed light field representation data comprising: obtaining, using a processor, compressed light field representation data, wherein the compressed light field representation data contains a compressed representation of a plurality of images of a scene captured from multiple points of view comprising a compressed representation of a reference image, a depth map, and prediction error data; decompressing a reference image, a depth map, and prediction error data from the compressed light field representation data; forming at least one alternate view image by: computing at least one prediction image using the reference image and the depth map; and applying the prediction error data to modify the pixels of the at least one computed prediction image to generate the at least one alternate view image; wherein the reference image and the at least one alternative view image form a light field comprising a plurality of images captured from multiple points of view.