In this paper, we address the following research problem: How can we generate a meaningful split grammar that explains a given facade layout? To evaluate if a grammar is meaningful, we propose a cost function based on the description length and minimize this cost using an approximate dynamic programming framework. Our evaluation indicates that our framework extracts meaningful split grammars that are competitive with those of expert users, while some users and all competing automatic solutions are less successful.
Our work builds on grammar-based procedural modeling. We mainly use splitting rules as they are commonly employed for facade modeling @cite_25 @cite_8 . For the generation of mass models, turtle commands like translate, rotate, and scale @cite_33 @cite_8 are often more useful. One goal of our work is the user-friendly generation of grammar rules. Here, the interactive editing framework of or a visual programming interface @cite_13 are other useful tools that contribute to the same goal. Finally, other approaches try to generate facade layouts without the use of grammars. work directly on textures, and use optimization, and propose a sampling algorithm for a probabilistic model using factor graphs.
@cite_13 @cite_25 @cite_33 @cite_8
2073581653 2148052781 2155296376 2154484971
Abstract Frequently, terrestrial LiDAR and image data are used to extract high resolution building geometry like windows, doors and protrusions for three-dimensional (3D) facade reconstruction. However, such a purely data driven bottom-up modelling of facade structures is only feasible if the available observations meet considerable requirements on data quality. Errors in measurement, varying point densities, reduced accuracies, as well as incomplete coverage affect the achievable correctness and reliability of the reconstruction result. While dependence on data quality is a general disadvantage with data driven bottom-up approaches, model based top-down reconstructions are much more robust. Algorithms introduce knowledge about the appearance and arrangement of objects. Thus, they cope with data uncertainty and allow for a procedural modelling of building structures in a predefined architectural style, which is inherent in grammar or model descriptions. We aim at a quality sensitive facade reconstruction which is on the one hand robust against erroneous and incomplete data, but on the other hand not subject to prespecified rules or models. For this purpose, we combine bottom-up and top-down strategies by integrating automatically inferred rules into a data driven reconstruction process. Facade models reconstructed during a bottom-up method serve as a knowledge base for further processing. Dominant or repetitive features and regularities as well as their hierarchical relationship are detected from the modelled facade elements and automatically translated into rules. These rules together with the 3D representations of the modelled facade elements constitute a formal grammar. It holds all the information which is necessary to reconstruct facades in the style of the given building. The paper demonstrates that the proposed algorithm is very flexible towards different data quality and incomplete sensor data. The inferred grammar is used for the verification of the facade model produced during the data driven reconstruction process and the generation of synthetic facades for which only partial or no sensor data is available. Moreover, knowledge propagation is not restricted to facades of one single building. Based on a small set of formal grammars derived from just a few observed buildings, facade reconstruction is also possible for whole districts featuring uniform architectural styles. Urban models are key to navigation, architecture and entertainment. Apart from visualizing facades, a number of tedious tasks remain largely manual (e.g. compression, generating new facade designs and structurally comparing facades for classification, retrieval and clustering). We propose a novel procedural modelling method to automatically learn a grammar from a set of facades, generate new facade instances and compare facades. To deal with the difficulty of grammatical inference, we reformulate the problem. Instead of inferring a compromising, one-size-fits-all, single grammar for all tasks, we infer a model whose successive refinements are production rules tailored for each task. We demonstrate our automatic rule inference on datasets of two different architectural styles. Our method supercedes manual expert work and cuts the time required to build a procedural model of a facade from several days to a few milliseconds. We propose a novel grammar-driven approach for reconstruction of buildings and landmarks. Our approach complements Structure-from-Motion and image-based analysis with a 'inverse' procedural modeling strategy. So far, procedural modeling has mostly been used for creation of virtual buildings, while the inverse approaches typically focus on reconstruction of single facades. In our work, we reconstruct complete buildings as procedural models using template shape grammars. In the reconstruction process, we let the grammar interpreter automatically decide on which step to take next. The process can be seen as instantiating the template by determining the correct grammar parameters. As an example, we have chosen the reconstruction of Greek Doric temples. This process significantly differs from single facade segmentation due to the immediate need for 3D reconstruction. In this paper, we use shape grammars (SGs) for facade parsing, which amounts to segmenting 2D building facades into balconies, walls, windows, and doors in an architecturally meaningful manner. The main thrust of our work is the introduction of reinforcement learning (RL) techniques to deal with the computational complexity of the problem. RL provides us with techniques such as Q-learning and state aggregation which we exploit to efficiently solve facade parsing. We initially phrase the 1D parsing problem in terms of a Markov Decision Process, paving the way for the application of RL-based tools. We then develop novel techniques for the 2D shape parsing problem that take into account the specificities of the facade parsing problem. Specifically, we use state aggregation to enforce the symmetry of facade floors and demonstrate how to use RL to exploit bottom-up, image-based guidance during optimization. We provide systematic results on the Paris building dataset and obtain state-of-the-art results in a fraction of the time required by previous methods. We validate our method under diverse imaging conditions and make our software and results available online.