1. A stereoscopic image processing apparatus for calculating a parallax between a pair of images, comprising: correlation evaluating means for evaluating a correlation of brightness between a first pixel block provided in one of said pair of images and a second pixel block provided in the other of said pair of images; and region size changing over means for changing over a size of said first and second pixel blocks in evaluating said correlation.