1. A method comprising: identifying a subset of frames in a two-dimensional video, the subset of frames comprising moving objects and static objects; determining a global camera motion value for the subset of frames; determining a dense motion value for a plurality of pixels in the subset of frames; comparing, by a processing device, the global camera motion value and the dense motion value to calculate a local motion value for each of the plurality of pixels; determining, for each of the plurality of pixels, whether a local motion value of a respective pixel satisfies a first threshold condition or a second threshold condition; responsive to the local motion value of the respective pixel satisfying the first threshold condition, assigning a first value to represent the local motion value of the respective pixel, and responsive to the local motion value of the respective pixel satisfying the second threshold condition, assigning a second value to represent the local motion value of the respective pixel, wherein the first value indicates that the respective pixel is associated with one of the moving objects, and the second value indicates that a corresponding pixel is associated with one of the static objects, wherein the assigning of the first and second values results in the plurality of pixels each being assigned either the first value or the second value; generating a rough depth map for the subset of frames using assigned first and second values of the plurality of pixels and locations of the plurality of pixels in the subset of the frames; interpolating, based on the rough depth map, a depth value for each of the plurality of pixels in the subset of frames; and rendering a three-dimensional video from the subset of frames using the depth value for each of the plurality of pixels.