This paper presents a novel appearance and shape feature, RISAS, which is robust to viewpoint, illumination, scale and rotation variations. RISAS consists of a keypoint detector and a feature descriptor both of which utilise texture and geometric information present in the appearance and shape channels. A novel response function based on the surface normals is used in combination with the Harris corner detector for selecting keypoints in the scene. A strategy that uses the depth information for scale estimation and background elimination is proposed to select the neighbourhood around the keypoints in order to build precise invariant descriptors. Proposed descriptor relies on the ordering of both grayscale intensity and shape information in the neighbourhood. Comprehensive experiments which confirm the effectiveness of the proposed RGB-D feature when compared with CSHOT and LOIND are presented. Furthermore, we highlight the utility of incorporating texture and shape information in the design of both the detector and the descriptor by demonstrating the enhanced performance of CSHOT and LOIND when combined with RISAS detector.
Descriptors can also be constructed using 3D geometric information. Johnson and Hebert @cite_14 proposed spin image which is a data level descriptor that can be used to match surfaces represented as meshes. With the development of low-cost RGB-D sensors, geometric information of the environment can be easily captured thus 3D shape descriptors have attracted renewed attention. More recent developments include PFH @cite_19 , FPFH(Fast PFH) and SHOT(Signature of Histograms of OrienTations). proposed PFH @cite_19 which is a multi-dimensional histogram which characterises the local geometry of a given keypoint. PFH is invariant to position, orientation and point cloud density. Enhanced version of PFH, termed FPFH @cite_6 reduces the complexity of PFH from @math to @math where @math is the number of points in the neighbourhood of the keypoint. SHOT descriptor proposed by @cite_9 is another example of a widely used local surface descriptor. SHOT encodes the histograms of the surface normals in different partitions in the support region.
@cite_19 @cite_9 @cite_14 @cite_6
2151837863 2160821342 1972485825 2059697919
In this paper we present a new approach for labeling 3D points with different geometric surface primitives using a novel feature descriptor - the Fast Point Feature Histograms, and discriminative graphical models. To build informative and robust 3D feature point representations, our descriptors encode the underlying surface geometry around a point p using multi-value histograms. This highly dimensional feature space copes well with noisy sensor data and is not dependent on pose or sampling density. By defining classes of 3D geometric surfaces and making use of contextual information using Conditional Random Fields (CRFs), our system is able to successfully segment and label 3D point clouds, based on the type of surfaces the points are lying on. We validate and demonstrate the method's efficiency by comparing it against similar initiatives as well as present results for table setting datasets acquired in indoor environments. In our recent work [1], [2], we proposed Point Feature Histograms (PFH) as robust multi-dimensional features which describe the local geometry around a point p for 3D point cloud datasets. In this paper, we modify their mathematical expressions and perform a rigorous analysis on their robustness and complexity for the problem of 3D registration for overlapping point cloud views. More concretely, we present several optimizations that reduce their computation times drastically by either caching previously computed values or by revising their theoretical formulations. The latter results in a new type of local features, called Fast Point Feature Histograms (FPFH), which retain most of the discriminative power of the PFH. Moreover, we propose an algorithm for the online computation of FPFH features for realtime applications. To validate our results we demonstrate their efficiency for 3D registration and propose a new sample consensus based method for bringing two datasets into the convergence basin of a local non-linear optimizer: SAC-IA (SAmple Consensus Initial Alignment). AbstractThis paper presents alocal3D descriptor forsurface matching dubbed SHOT.Our proposal stems from a taxonomy of existing methods which highlightstwo major approaches, referred to as Signatures and Histograms, inher-ently emphasizing descriptiveness and robustness respectively. We formulatea comprehensive proposal which encompasses a repeatable local referenceframe as well as a 3D descriptor, the latter featuring an hybrid structurebetween Signatures and Histograms so as to aim at a more favorable bal-ance between descriptive power and robustness. A quite peculiar trait of ourmethod concerns seamless integration of multiple cues within the descrip-tor to improve distinctiveness, which is particularly relevant nowadays dueto the increasing availability of aﬀordable RGB-D sensors which can gatherboth depth and color information. A thorough experimental evaluation basedon datasets acquired with diﬀerent types of sensors, including a novel RGB-D dataset, vouches that SHOT outperforms state-of-the-art local descriptorsin experiments addressing descriptor matching for object recognition, 3Dreconstruction and shape retrieval.Keywords: Surface Matching, 3D Descriptors, Object Recognition, 3DReconstruction1. IntroductionAutomatic recognition of shapes in 3D data, also referred to as surfacematching, attracts growing interest in the research community, with appli-cation to areas such as shape retrieval, 3D reconstruction, object recogni-tion categorization, manipulation and grasping, robot localization and nav-igation. A key enabling factor for the development of this technology is In this work, we propose and experiment an original solution to 3D face recognition that supports face matching also in the case of probe scans with missing parts. In the proposed approach, distinguishing traits of the face are captured by first extracting 3D keypoints of the scan and then measuring how the face surface changes in the keypoints neighborhood using local shape descriptors. In particular: 3D keypoints detection relies on the adaptation to the case of 3D faces of the meshDOG algorithm that has been demonstrated to be effective for 3D keypoints extraction from generic objects; as 3D local descriptors we used the HOG descriptor and also proposed two alternative solutions that develop, respectively, on the histogram of orientations and the geometric histogram descriptors. Face similarity is evaluated by comparing local shape descriptors across inlier pairs of matching keypoints between probe and gallery scans. The face recognition accuracy of the approach has been first experimented on the difficult probes included in the new 2D 3D Florence face dataset that has been recently collected and released at the University of Firenze, and on the Binghamton University 3D facial expression dataset. Then, a comprehensive comparative evaluation has been performed on the Bosphorus, Gavab and UND FRGC v2.0 databases, where competitive results with respect to existing solutions for 3D face biometrics have been obtained. Graphical abstractDisplay Omitted Highlights3D face recognition approach deployable in real non-cooperative contexts of use.Fully-3D approach, based on keypoints detection, description and matching.MeshDOG keypoints detector combined with the multi-ring GH descriptor.RANSAC algorithm included for outlier removal from matching keypoints.State of the art accuracy for recognizing 3D scans with missing parts.