1. An apparatus for generating and consuming a three-dimensional (3D) data format, the apparatus comprising: an image preprocessing unit to search for a matching point between images captured by a plurality of cameras, and to extract, as image information, at least a depth value from each of the captured images; an image information structuring unit to structure 3D data to use the extracted image information to generate a realistic image; a 3D data format storage unit to store format information of the structured 3D data in to a database (DB); a realistic image generating unit to generate a realistic panoramic image using the stored format information of the 3D data by identifying each of a plurality of layered cylinders corresponding to a left image and a right image to be generated, generating a layer cylinder by wrapping an image in a layer matched to the depth value of a corresponding object, through image synthesis, using at least one of geometric position information, object and area division information and texture information of a multi-image stored in the DB; and a realistic image rendering unit to perform rendering on the generated realistic panoramic image.