1. A method of determining stereo views of a stereoscopic image, the method comprising: selecting a pair of first and second images from frames of the stereoscopic image, wherein the selected pair of the first and second images comprises a left view image and a right view image and the first image and the second image are different views of a subject obtained by a first camera and a second camera, respectively; performing a disparity estimation with regard to the first and second images by using a parallax between the pair of first and second images obtained by the first camera and the second camera; determining a disparity vector for each of the plurality of corresponding blocks; counting a number of positive directions of the disparity vectors and the number of negative directions of the disparity vectors; determining a disparity vector of the first and second images to he in a positive direction if there is a greater number of disparity vectors of the plurality of corresponding blocks which are in the positive direction, and determining a disparity vector of the first and second images to be in a negative direction if there is a greater number of disparity vectors of the plurality of corresponding blocks which are in the negative direction; and determining which of the first image and the second image is the left view image and which of the first image and the second image is the right view image based on the determined disparity vector.