1. A method comprising: receiving image frames that are captured by two or more camera modules of a camera array at a particular time; interpolating a first virtual camera between a first set of camera modules from the two or more camera modules; determining a first set of disparity maps between the first set of camera modules; generating, by a processor-based computing device programmed to perform the generating, a first virtual camera image associated with the particular time for the first virtual camera from a first set of image frames that are captured by the first set of camera modules at the particular time, the first virtual camera image being generated based on the first set of disparity maps; and constructing a left panoramic image and a right panoramic image associated with the particular time from the image frames captured by the two or more camera modules and the first virtual camera image of the first virtual camera.