1. An information processing apparatus comprising: an input unit configured to input a plurality of images captured from a plurality of viewpoints; an extraction unit configured to extract a region of an object from each of the plurality of images based on color information; an acquisition unit configured to obtain a contour from each region extracted by the extraction unit; a smoothing unit configured to obtain a plurality of smoothed contours by performing smoothing of each of the contours; a correlation unit configured to correlate points on the plurality of smoothed contours between the images; and a deriving unit configured to derive a three-dimensional coordinate of the points correlated by the correlation unit between the images, wherein the smoothing unit includes an endpoint setting unit configured to set a first point and a second point on the contour and a setting unit configured to set a third point between the first point and the second point on the contour, wherein the smoothing unit is configured to repeat an operation of the endpoint setting unit and an operation of the setting unit so that the third point is recursively set as the first point or the second point until a distance between the first point or the second point and the third point is smaller than a predetermined value and that the recursively set point between the first point and the second point is newly set as the third point, and wherein the smoothing unit is configured to obtain, as the smoothed contours, a group of lines connecting adjacent points on the contours among the points set by the endpoint setting unit and the setting unit.