1. A multiple lens imaging apparatus comprising: a plurality of imaging unit for obtaining images by photography; and exposure setting unit for using an exposure value calculated according to a result of photometric measurement for predetermined main imaging unit among the plurality of imaging unit, to set exposure of the main imaging unit and sub-imaging unit other than the main imaging unit, wherein, in the case where the number of the sub-imaging unit having obtained saturated images in photography by setting the exposure thereof according to the exposure value is larger than one, if the saturated images include an image saturated on a high luminance side and an image saturated on a low luminance side, the exposure setting unit calculates the exposure value separately for the sub-imaging unit having obtained the image saturated on the high luminance side and for the sub-imaging unit having obtained the image saturated on the low luminance side.