This paper presents a novel appearance and shape feature, RISAS, which is robust to viewpoint, illumination, scale and rotation variations. RISAS consists of a keypoint detector and a feature descriptor both of which utilise texture and geometric information present in the appearance and shape channels. A novel response function based on the surface normals is used in combination with the Harris corner detector for selecting keypoints in the scene. A strategy that uses the depth information for scale estimation and background elimination is proposed to select the neighbourhood around the keypoints in order to build precise invariant descriptors. Proposed descriptor relies on the ordering of both grayscale intensity and shape information in the neighbourhood. Comprehensive experiments which confirm the effectiveness of the proposed RGB-D feature when compared with CSHOT and LOIND are presented. Furthermore, we highlight the utility of incorporating texture and shape information in the design of both the detector and the descriptor by demonstrating the enhanced performance of CSHOT and LOIND when combined with RISAS detector.
SIFT is one of the most well-known visual features @cite_4 . SIFT combines a Difference-of-Gaussian interest region detector and a gradient orientation histogram as the descriptor. By constructing the descriptor from a scale and orientation normalised image patch, SIFT exhibits robustness to scale and rotation variations. SURF, proposed by @cite_2 , relies on integral images for image convolution. SURF uses a Hessian matrix-based measure for the detector and a distribution-based descriptor. @cite_7 proposed BRIEF which uses a binary string as the descriptor. BRIEF feature takes relatively less memory and can be matched fast using Hamming distance in real-time with very limited computational resources. However, BRIEF is not designed to be robust to scale variations. @cite_5 proposed BRISK(Binary Robust Invariant Scalable Keypoints) which has a scale invariant keypoint detector and binary string like descriptor. ORB, another well-known binary feature, proposed by @cite_17 , has been widely used in SLAM community @cite_0 . ORB is invariant to rotation variations and more robust to noise compared with BRIEF.
@cite_4 @cite_7 @cite_0 @cite_2 @cite_5 @cite_17
2117228865 2106608297 1677409904 2145072179
Feature matching is at the base of many computer vision problems, such as object recognition or structure from motion. Current methods rely on costly descriptors for detection and matching. In this paper, we propose a very fast binary descriptor based on BRIEF, called ORB, which is rotation invariant and resistant to noise. We demonstrate through experiments how ORB is at two orders of magnitude faster than SIFT, while performing as well in many situations. The efficiency is tested on several real-world applications, including object detection and patch-tracking on a smart phone. This paper proposes a novel geometric distortion resilient image copy detection scheme based on Scale Invariant Feature Transform (SIFT) detector. By using the SIFT detector, the proposed copy detection scheme first construct a series of robust, homogenous, and larger size circular patches. And then, the cirque track division strategy and ordinal measure concept are introduced to generate a cirque-based ordinal measure feature vector for each circular patch. Besides, the ROC graph and MAP probability are utilized to estimate the two parameters (vector dimension and detection threshold) respectively. Experimental results and the related analysis show that the proposed scheme is robust to most of geometric and photometric distortions. In this paper, we present a novel scale- and rotation-invariant interest point detector and descriptor, coined SURF (Speeded Up Robust Features). It approximates or even outperforms previously proposed schemes with respect to repeatability, distinctiveness, and robustness, yet can be computed and compared much faster. This is achieved by relying on integral images for image convolutions; by building on the strengths of the leading existing detectors and descriptors (in casu, using a Hessian matrix-based measure for the detector, and a distribution-based descriptor); and by simplifying these methods to the essential. This leads to a combination of novel detection, description, and matching steps. The paper presents experimental results on a standard evaluation set, as well as on imagery obtained in the context of a real-life object recognition application. Both show SURF's strong performance. Stable local feature detection and representation is a fundamental component of many image registration and object recognition algorithms. Mikolajczyk and Schmid (June 2003) recently evaluated a variety of approaches and identified the SIFT [D. G. Lowe, 1999] algorithm as being the most resistant to common image deformations. This paper examines (and improves upon) the local image descriptor used by SIFT. Like SIFT, our descriptors encode the salient aspects of the image gradient in the feature point's neighborhood; however, instead of using SIFT's smoothed weighted histograms, we apply principal components analysis (PCA) to the normalized gradient patch. Our experiments demonstrate that the PCA-based local descriptors are more distinctive, more robust to image deformations, and more compact than the standard SIFT representation. We also present results showing that using these descriptors in an image retrieval application results in increased accuracy and faster matching.