1. An image processing apparatus comprising: an acquiring unit that acquires two or more groups of a series of images captured in series from two or more different viewpoints in order to generate a stereoscopic view image for viewing stereoscopically; a distance measuring unit that measures a distance to an object for each image of the captured images in series; and a parallax adjustment amount calculating unit that determines an adjustment amount of a parallax amount adjusted between one of the series of captured images selected based on a statistical value of the distance measured by the distance measuring unit and another image that is captured from a different viewpoint and corresponds to the captured image to be the adjustment amount of the parallax amount between panorama images when the series of captured images is combined with each other to generate the panorama images in each of the two or more groups.