1. An image processing method comprising: receiving a first image in which a subject image has been taken into mutually different pixels simultaneously through a single optical system in a standard direction view point, a left direction view point, and a right direction view point by using an image sensor, the image sensor comprising a pixel array including a plurality of pixels having one aperture mask per pixel, the plurality of pixels including non-parallax pixels having an aperture mask producing a view point in a standard direction, left parallax pixels having an aperture mask producing parallax in a left direction with respect to the standard direction, and right parallax pixels having an aperture mask producing parallax in a right direction with respect to the standard direction; for converting the first image into an image from the left direction view point and an image from the right direction view point, the method comprising the steps of: generating a temporary left parallax image using, for each pixel, a pixel value of the left parallax pixels of the first image; generating a temporary right parallax image using, for each pixel, a pixel value of the right parallax pixels of the first image; generating a standard view point image using, for each pixel, a pixel value of at least the non-parallax pixels of the first image; generating an edge enhanced standard view point image, by carrying out an edge enhancement process on the standard view point image; and generating a left direction view point image and a right direction view point image based on the edge enhanced standard view point image, the temporary left parallax image, and the temporary right parallax image for each pixel.