In this work, we present a novel and practical approach to address one of the longstanding problems in computer vision: 2D and 3D affine invariant feature matching. Our Grassmannian Graph (GrassGraph) framework employs a two stage procedure that is capable of robustly recovering correspondences between two unorganized, affinely related feature (point) sets. The first stage maps the feature sets to an affine invariant Grassmannian representation, where the features are mapped into the same subspace. It turns out that coordinate representations extracted from the Grassmannian differ by an arbitrary orthonormal matrix. In the second stage, by approximating the Laplace-Beltrami operator (LBO) on these coordinates, this extra orthonormal factor is nullified, providing true affine-invariant coordinates which we then utilize to recover correspondences via simple nearest neighbor relations. The resulting GrassGraph algorithm is empirically shown to work well in non-ideal scenarios with noise, outliers, and occlusions. Our validation benchmarks use an unprecedented 440,000+ experimental trials performed on 2D and 3D datasets, with a variety of parameter settings and competing methods. State-of-the-art performance in the majority of these extensive evaluations confirm the utility of our method.
Algorithms that address non-rigid transformations inherently have an advantage over strictly affine methods, here we highlight some notable non-rigid methods that can be used to address the affine correspondence problem. @cite_28 form an equi-affine (volume preserving) invariant Laplacian for surfaces, with applications in shape matching. Their method, however, requires explicit metric tensor calculations on mesh surfaces which can lead to further complications of singular points on the surfaces. We avoid surfaces parameterization issues, offering an approach that works directly on point sets. Popular non-rigid matching algorithms include CPD @cite_17 , gmmreg @cite_10 and TPS-RPM @cite_26 . Graph matching methods have also been quite popular recently. Zhou and de la Torre @cite_31 @cite_35 presented the factorized graph matching (FGM) algorithm in which the affinity matrix is factorized as a Kronecker product of smaller matrices. Although the factorization of affinity matrices makes large graph matching problems more tractable, the method is still computationally expensive.
@cite_35 @cite_26 @cite_28 @cite_31 @cite_10 @cite_17
2076080556 2125535259 1969552659 2094539604
Graph matching plays a central role in solving correspondence problems in computer vision. Graph matching problems that incorporate pair-wise constraints can be cast as a quadratic assignment problem (QAP). Unfortunately, QAP is NP-hard and many algorithms have been proposed to solve different relaxations. This paper presents factorized graph matching (FGM), a novel framework for interpreting and optimizing graph matching problems. In this work we show that the affinity matrix can be factorized as a Kronecker product of smaller matrices. There are three main benefits of using this factorization in graph matching: (1) There is no need to compute the costly (in space and time) pair-wise affinity matrix; (2) The factorization provides a taxonomy for graph matching and reveals the connection among several methods; (3) Using the factorization we derive a new approximation of the original problem that improves state-of-the-art algorithms in graph matching. Experimental results in synthetic and real databases illustrate the benefits of FGM. The code is available at http: humansensing.cs.cmu.edu fgm. This paper proposes an affine invariant matching algorithm for shape correspondence problems in arbitrary dimensions. Formulating shapes by configuration matrices of landmarks, and using the fact that subspaces (e.g. range spaces) of these matrices are invariant to affine transformations, the shape correspondence is modelled as a permutation relation between orthogonal projection matrices of the subspaces. Then the matching result is solved by an efficient factorization procedure for rank-deficient matrices. The algorithm is compact, fast, and independent of dimensions. Experimental results for 1D, 2D and 3D matchings of synthetic and real data are provided, which demonstrate potential applications of the algorithm to shape analysis, and to other related problems like wide baseline stereo matching and range data registration. We present a novel Object Recognition approach based on affine invariant regions. It actively counters the problems related to the limited repeatability of the region detectors, and the difficulty of matching, in the presence of large amounts of background clutter and particularly challenging viewing conditions. After producing an initial set of matches, the method gradually explores the surrounding image areas, recursively constructing more and more matching regions, increasingly farther from the initial ones. This process covers the object with matches, and simultaneously separates the correct matches from the wrong ones. Hence, recognition and segmentation are achieved at the same time. The approach includes a mechanism for capturing the relationships between multiple model views and exploiting these for integrating the contributions of the views at recognition time. This is based on an efficient algorithm for partitioning a set of region matches into groups lying on smooth surfaces. Integration is achieved by measuring the consistency of configurations of groups arising from different model views. Experimental results demonstrate the stronger power of the approach in dealing with extensive clutter, dominant occlusion, and large scale and viewpoint changes. Non-rigid deformations are explicitly taken into account, and the approximative contours of the object are produced. All presented techniques can extend any view-point invariant feature extractor. Graph matching (GM) is a fundamental problem in computer science, and it has been successfully applied to many problems in computer vision. Although widely used, existing GM algorithms cannot incorporate global consistence among nodes, which is a natural constraint in computer vision problems. This paper proposes deformable graph matching (DGM), an extension of GM for matching graphs subject to global rigid and non-rigid geometric constraints. The key idea of this work is a new factorization of the pair-wise affinity matrix. This factorization decouples the affinity matrix into the local structure of each graph and the pair-wise affinity edges. Besides the ability to incorporate global geometric transformations, this factorization offers three more benefits. First, there is no need to compute the costly (in space and time) pair-wise affinity matrix. Second, it provides a unified view of many GM methods and extends the standard iterative closest point algorithm. Third, it allows to use the path-following optimization algorithm that leads to improved optimization strategies and matching performance. Experimental results on synthetic and real databases illustrate how DGM outperforms state-of-the-art algorithms for GM. The code is available at http: humansensing.cs.cmu.edu fgm.