1. An image processing apparatus comprising: a left eye image input unit configured to input a left eye image (L image) which is a left eye image signal applied to three-dimensional image display; a right eye image input unit configured to input a right eye image (R image) which is a right eye image signal applied to three-dimensional image display; a parallax information generating unit configured to generate parallax information from the left eye image (L, image) and the right eye image (R image); and a virtual view point image generating unit configured to receive the left eye image (L image), the right eye image (R image), and the parallax information, and generate virtual view point images including a view point image other than view points of the received LR images, wherein the virtual view point image generating unit determines virtual view point positions by means of processing in view of at least one of image qualities of virtual view point images, an appropriate amount of parallax, or an image weight according to an image region, and generates the virtual view point images corresponding to the determined virtual view point positions, wherein the virtual view point image generating unit determines a first virtual view point position by means of processing in view of at least one of an image quality of a virtual view point image, an appropriate amount of parallax, or an image weight according to an image region, determines a second virtual view point position of non-regular interval by means of non-linear mapping processing performed on the determined first virtual view point position, and generates a virtual view point image corresponding to the determined second virtual view point position of the non-regular interval, and wherein the left eye image input unit, the right eye image input unit, the parallax information generating unit, and the virtual view point image generating unit are each implemented via at least one processor.