1. An apparatus temporally interpolating a three-dimensional (3D) depth image, the apparatus comprising: a temporal interpolation unit to interpolate depth images using a temporal interpolation procedure, the depth images being generated from a depth camera; and an intermediate depth image generator to generate an intermediate depth image in a new time using the interpolated depth images.