1. A three dimensional modeling apparatus for generating three dimensional shape data of a three dimensional object, comprising: projection means for projecting pattern light onto said three dimensional object; image input means for inputting an image of said three dimensional object; rough shape calculation means for calculating a rough shape from said image; detailed shape calculation means for calculating a detailed shape from said image; and three dimensional shape data generating means for generating three dimensional shape data of said three dimensional object based on said rough shape and said detailed shape.