Mobile robots operating on unstructured terrain must predict which areas of the environment they are able to pass in order to plan feasible paths and to react to unforeseen terrain patterns. We address traversability estimation as a heightmap classification problem: we build a convolutional neural network that, given an image representing the heightmap of a terrain patch, predicts whether the robot will be able to traverse such patch from left to right. The classifier is trained for a specific wheeled robot model (but may implement any other locomotion type such as tracked, legged, snake-like), using simulation data on a variety of procedurally generated training terrains; once trained, the classifier can quickly be applied to patches extracted from unseen large heightmaps, in multiple orientations, thus building oriented traversability maps. We quantitatively validate the approach on real-elevation datasets and implement a path planning approach that employs our traversability estimation.
. Using a supervised learning approach exempts one from the need to manually define the link between the input data and traversability; on the other hand, it requires a set of labeled examples, whose size, quality and representativeness are key to the final performance: the strategy adopted to acquire such training data is an important (and sometimes, prevailing) component of all related literature @cite_28 . Our approach exclusively relies on training data acquired from simulations on procedurally-generated terrains: this allows us to cheaply generate large datasets for data-hungry deep learning models. This approach has not yet been attempted in the traversability literature, but training from simulations is a common strategy for learning manipulation or legged locomotion skills, especially when reinforcement learning techniques are adopted @cite_33 @cite_5 .
@cite_28 @cite_5 @cite_33
1974868116 2211115409
Motion planning for unmanned ground vehicles (UGV) constitutes a domain of research where several disciplines meet, ranging from artificial intelligence and machine learning to robot perception and computer vision. In view of the plurality of related applications such as planetary exploration, search and rescue, agriculture, mining and off-road exploration, the aim of the present survey is to review the field of 3D terrain traversability analysis that is employed at a preceding stage as a means to effectively and efficiently guide the task of motion planning. We identify that in the epicenter of all related methodologies, 3D terrain information is used which is acquired from LIDAR, stereo range data, color or other sensory data and occasionally combined with static or dynamic vehicle models expressing the interaction of the vehicle with the terrain. By taxonomizing the various directions that have been explored in terrain perception and analysis, this review takes a step toward agglomerating the dispersed contributions from individual domains by elaborating on a number of key similarities as well as differences, in order to stimulate research in addressing the open challenges and inspire future developments. Crowdsourced 3D CAD models are becoming easily accessible online, and can potentially generate an infinite number of training images for almost any object category.We show that augmenting the training data of contemporary Deep Convolutional Neural Net (DCNN) models with such synthetic data can be effective, especially when real training data is limited or not well matched to the target domain. Most freely available CAD models capture 3D shape but are often missing other low level cues, such as realistic object texture, pose, or background. In a detailed analysis, we use synthetic CAD-rendered images to probe the ability of DCNN to learn without these cues, with surprising findings. In particular, we show that when the DCNN is fine-tuned on the target detection task, it exhibits a large degree of invariance to missing low-level cues, but, when pretrained on generic ImageNet classification, it learns better when the low-level cues are simulated. We show that our synthetic DCNN training approach significantly outperforms previous methods on the PASCAL VOC2007 dataset when learning in the few-shot scenario and improves performance in a domain shift scenario on the Office benchmark.