1. A method for generating an image of an object from a vantage point, the object being represented by a plenoptic function having coefficients stored in a memory, the coefficients representing intensity values of light rays emanating from the object that pass through predefined points on a surface surrounding the object and in predefined directions through each point, the method comprising: receiving the coefficients of the plenoptic function, the plenoptic function for generating intensity values of light rays emanating from the object and passing through the surface surrounding the object; and for each of a plurality of pixels of the image, determining a point on the surface surrounding the object and a direction of a light ray that passes through the determined point and that contributes to the pixel of the image; generating an intensity for the pixel by, when a stored coefficient represents the intensity value of the light ray emanating from the object that passes through the determined point in the determined direction, evaluating the plenoptic function at that determined point and direction to generate an intensity for the pixel; and when a stored coefficient does not represent the intensity value of the light ray emanating from the object that passes through the determined point in the determined direction, generating the intensity for the pixel by, identifying multiple light rays emanating from the object that pass through predefined points on the surface surrounding the object and in predefined directions through each point such that the light rays pass near the pixel; evaluating the plenoptic function at the predefined point and direction for each of the identified light rays to determine an intensity; and combining the determined intensities for the multiple identified light rays into the generated intensity for the pixel; and setting the pixel to the generated intensity.