1. An image processing apparatus comprising: an acquisition unit configured to acquire, for each of respective viewpoints, capturing condition at the viewpoint, and each frame image captured from the viewpoint in accordance with the capturing condition; and a prediction coding unit configured to perform prediction coding for the frame images acquired by the acquisition unit, wherein the respective viewpoints include (i) a reference viewpoint being defined based on the capturing conditions at the respective viewpoints, (ii) a first viewpoint, and (iii) a second viewpoint, wherein a value representing the capturing condition at the first viewpoint is less than a value representing the capturing condition at the reference viewpoint and a value representing the capturing condition at the second viewpoint is more than a value representing the capturing condition at the reference viewpoint, and wherein if the prediction coding unit performs prediction coding for the frame image captured from one viewpoint of the first and second viewpoints, the prediction coding unit generates a predicted picture by using at least one of the frame image captured from the reference viewpoint and the frame image captured from the one viewpoint as a reference picture without using the frame image captured from another viewpoint of the first and second viewpoints as the reference picture and performs prediction coding for the frame image captured from the one viewpoint by using the generated predicted picture, wherein at least one processor is used to implement the units of the apparatus.