1. An image processing device, comprising: an image processing unit, which corrects a depth image formed of a depth value indicating a position in a depth direction of each pixel of a color image of a predetermined viewpoint based on a change in viewer positional information indicating that a position of a viewer is moved in a depth direction with regard to a position at which the depth image is displayed, wherein the image processing unit determines a central point of scaling of the depth image and the color image of the predetermined viewpoint based on the change in viewer positional information, determines a scaling rate of each pixel of the depth image and the color image of the predetermined viewpoint so as to be a larger depth value scaling rate for pixels having a larger horizontal distance from the central point and a smaller initial depth value prior to the change in viewer positional information, and performs the scaling of the depth value and a pixel value forming the color image of the predetermined viewpoint centering around the central point at the scaling rate of the pixel for each pixel, wherein the scaling rate of each pixel of the depth image and the color image of the predetermined viewpoint changes based on the change in viewer positional information, and wherein the image processing unit is implemented via at least one processor.