1. An image processing apparatus which performs an image process on an image to which condition information representing a condition at a time when an image was shot has been added, comprising: an analyzing unit configured to analyze condition information indicating whether or not the image was shot in a manual mode, the condition information representing a condition at a time when the image was shot and having been added to the image; a processing determining unit configured to determine an image processing condition based on an analysis result by said analyzing unit; and a processing unit configured to perform, on the image, a process according to the image processing condition determined by said processing determining unit, wherein, in a case where it is analyzed by said analyzing unit that the image was shot in a manual mode, said image processing apparatus permits a user to choose whether or not to perform the process by said processing unit, wherein the image processing condition is a correction amount of the color balance of the image, and the lightness of a highlight point of the image and the lightness of a shadow point thereof are detected by said processing determining unit which is configured to obtain the correction amount of the color balance of the image, wherein colors of the highlight point and the shadow point are obtaining from plural pixels having said lightness, and wherein the process performed by said processing unit is a color correction process, and the color correction process is performed on the image based on the highlight point, the shadow point and the colors of these points.