1. A stereoscopic image display apparatus for generating and displaying a stereoscopic image that forms a three-dimensional image on a retina of a viewer, comprising: a critical parallax calculating unit for calculating a critical parallax that is the boundary of a parallax capable of forming a three-dimensional image on a retina of the viewer; a rectangular parallelepiped dimension calculating unit for calculating the dimensions of a rectangular parallelepiped inscribing a sphere having a diameter equal to the calculated critical parallax; a space dividing unit for dividing a space including an object into multiple spaces using the calculated rectangular parallelepiped; a gazing point image generating unit for generating a stereoscopic image of the object with respect to a single gazing point for each divided space; a gazing point image pasting unit for pasting the generated multiple stereoscopic images together to generate a single stereoscopic image; and an image displaying unit for displaying the generated single stereoscopic image.