In this paper, an stereo-based traversability analysis approach for all terrains in off-road mobile robotics, e.g. Unmanned Ground Vehicles (UGVs) is proposed. This approach reformulates the problem of terrain traversability analysis into two main problems: (1) 3D terrain reconstruction and (2) terrain all surfaces detection and analysis. The proposed approach is using stereo camera for perception and 3D reconstruction of the terrain. In order to detect all the existing surfaces in the 3D reconstructed terrain as superpixel surfaces (i.e. segments), an image segmentation technique is applied using geometry-based features (pixel-based surface normals). Having detected all the surfaces, Superpixel Surface Traversability Analysis approach (SSTA) is applied on all of the detected surfaces (superpixel segments) in order to classify them based on their traversability index. The proposed SSTA approach is based on: (1) Superpixel surface normal and plane estimation, (2) Traversability analysis using superpixel surface planes. Having analyzed all the superpixel surfaces based on their traversability, these surfaces are finally classified into five main categories as following: traversable, semi-traversable, non-traversable, unknown and undecided.
Our recent work @cite_1 in terrain traversability estimation mainly proposed geometry based features such as pixel-based surface normals using a stereo camera for environment perception. Mainly, it was explained how these pixel-based surface normals can perform the generated terrain point cloud segmentation and terrain classification based on traversability criteria although the classification results were not accurate and robust enough in some cases such as: low quality of the generated point cloud lack of the dominant ground plane false classification of segments based on the traversability criteria such as max traversable step and slope step analysis was not clear enough or ignored
@cite_1
2239990147 2216023515 2095897920 2044903630
A stereo-based terrain classification for traversability estimation of all terrains in offroad mobile robots is presented. The proposed method defines the roughness of the surrounding terrain for every single pixel in the image or point in a point cloud using surface normals and also explains how this is applied to all terrain by knowing the kinematics capability, mechanical constraints and size of the UGV. Roughness estimation using surface normals helps us model the whole terrain with a virtual function which increases the accuracy of the resulting terrain travesability map considerably. This paper presents algorithms for fast segmentation of 3D point clouds and subsequent classification of the obtained 3D segments. The method jointly determines the ground surface and segments individual objects in 3D, including overhanging structures. When compared to six other terrain modelling techniques, this approach has minimal error between the sensed data and the representation; and is fast (processing a Velodyne scan in approximately 2 seconds). Applications include improved alignment of successive scans by enabling operations in sections (Velodyne scans are aligned 7 sharper compared to an approach using raw points) and more informed decision-making (paths move around overhangs). The use of segmentation to aid classification through 3D features, such as the Spin Image or the Spherical Harmonic Descriptor, is discussed and experimentally compared. Moreover, the segmentation facilitates a novel approach to 3D classification that bypasses feature extraction and directly compares 3D shapes via the ICP algorithm. This technique is shown to achieve accuracy on par with the best feature based classifier (92.1 ) while being significantly faster and allowing a clearer understanding of the classifier’s behaviour. This paper presents a rule-based fuzzy traversability index that quantifies the ease-of-traversal of a terrain by a mobile robot based on real-time measurements of terrain characteristics retrieved from imagery data. These characteristics include, but are not limited to slope, roughness, hardness, and discontinuity. The proposed representation of terrain traversability incorporates an intuitive, linguistic approach for expressing terrain characteristics that is robust with respect to imprecision and uncertainty in the terrain measurements. The terrain assessment method is tested and validated with a set of real-world imagery data. These tests demonstrate the capability of the terrain classification algorithm for perceiving hazards associated with terrain traversal. Purpose – This research aims to address the issue of safe navigation for autonomous vehicles in highly challenging outdoor environments. Indeed, robust navigation of autonomous mobile robots over long distances requires advanced perception means for terrain traversability assessment. Design methodology approach – The use of visual systems may represent an efficient solution. This paper discusses recent findings in terrain traversability analysis from RGB-D images. In this context, the concept of point as described only by its Cartesian coordinates is reinterpreted in terms of local description. As a result, a novel descriptor for inferring the traversability of a terrain through its 3D representation, referred to as the unevenness point descriptor (UPD), is conceived. This descriptor features robustness and simplicity. Findings – The UPD-based algorithm shows robust terrain perception capabilities in both indoor and outdoor environment. The algorithm is able to detect obstacles and terrain irregularities....