1. A method comprising: receiving, by an image manipulation application executed by a processing device, image data depicting an image space from a plurality of perspectives; generating, by the image manipulation application, at least one three-dimensional epipolar data structure from the image data, the at least one three-dimensional epipolar data structure comprising data describing a difference in position of at least one object between the plurality of perspectives, wherein the at least one three-dimensional epipolar data structure corresponds to at least one region of the image space; and generating, by the image manipulation application, a depth map based on the at least one three-dimensional epipolar data structure.