1. A method of matching stereo images, the method comprising: calculating a data cost value for each of a plurality of images, the plurality of images being acquired by photographing an identical scene from different points of view, the data cost value being indicative of an amount of computational energy for finding a color difference between the plurality of images; calculating a smoothness cost value for each of the plurality of images, the smoothness cost value being indicative of an amount of computational energy for smoothing the plurality of images; and matching pixels among the plurality of images based on the data cost value and the smoothness cost value, wherein the data cost value is calculated based on a geometric relationship among the pixels, the geometric relationship being determined based on binocular disparity information of the plurality of images, an initial cost value is assigned to a pixel having an impossible structure based on the geometric relationship when calculating the data cost value, and the smoothness cost value is calculated based on a similarity of binocular disparities between a selected pixel in a first image of the plurality of images and neighboring pixels of the selected pixel in the first image.