1. An image processing apparatus, comprising: a sensor unit to generate a color image and a depth image; a color-depth time difference correcting unit to correct a mismatching that occurs due to a time difference between a point in time when the color image is generated and a point in time when the depth image is generated; and an image generator to generate a three-dimensional (3D) image using the color image and the depth image after the mismatching is corrected.