1. A method of site modeling using image data, comprising: generating a two-dimensional segmentation by segmenting a building using three-dimensional line segments; generating a labeled segmentation of one or more structures based on the two-dimensional segmentation and geometric shapes representing portions of the one or more structures; and generating a three-dimensional model of said one or more structures based on said labeled segmentation.