1. A method comprising: receiving a two-dimensional image to be converted to a first three-dimensional image; identifying a second three-dimensional image sharing a characteristic with the two-dimensional image; identifying a feature-to-depth mapping function associated with the second three-dimensional image in a data store, the data store storing feature-to-depth mapping functions for a plurality of three-dimensional images comprising the second three-dimensional image sharing the characteristic with the two-dimensional image, each stored feature-to-depth mapping function computed for a stereo image pair associated with a corresponding three-dimensional image of the plurality of three-dimensional images, and wherein the feature-to-depth mapping function associated with the second three-dimensional image associates a plurality of pixels in the second three-dimensional image having a first color value with a depth value; determining a depth value for a plurality of pixels of the two-dimensional image according to the feature-to-depth mapping function; and generating, by a processing device, the first three-dimensional image based on the depth value for the plurality of pixels of the two-dimensional image.