Sparse representation-based classification (SRC), proposed by , seeks the sparsest decomposition of a test sample over the dictionary of training samples, with classification to the most-contributing class. Because it assumes test samples can be written as linear combinations of their same-class training samples, the success of SRC depends on the size and representativeness of the training set. Our proposed classification algorithm enlarges the training set by using local principal component analysis to approximate the basis vectors of the tangent hyperplane of the class manifold at each training sample. The dictionary in SRC is replaced by a local dictionary that adapts to the test sample and includes training samples and their corresponding tangent basis vectors. We use a synthetic data set and three face databases to demonstrate that this method can achieve higher classification accuracy than SRC in cases of sparse sampling, nonlinear class manifolds, and stringent dimension reduction.
On the other hand, approaches to address the limiting linear subspace assumption (i.e., the assumption that class manifolds are linear subspaces) in SRC have been proposed. For example, extended sparse coding and dictionary learning to general Riemannian manifolds @cite_11 . Admittedly only a first step in meeting their ultimate objective, 's work requires explicit knowledge of the class manifolds. This is an unsatisfiable condition in many real-world classification problems and is not a requirement of our proposed algorithm. Alternatively, have been effective in overcoming SRC's linearity assumption, as nonlinear relationships in the original space may be linear in kernel space given an appropriate choice of kernel @cite_8 . Several local'' modifications of SRC implicitly ameliorate the linearity assumption; in @cite_9 and (LSDL-SRC) @cite_15 , for instance, coefficients of the representation are constrained by their corresponding training samples' distances to the test sample, and so these algorithms need only assume linearity at the local level. Our proposed method is designed to improve not only the locality but also the accuracy of the approximation of the test sample in terms of its ground truth class. Section contains an experimental comparison between our proposed method and LSDL-SRC, as well as a discussion thereof.
@cite_8 @cite_9 @cite_15 @cite_11
2324335215 1989243451 2110383222 2142848040
Recently, sparse representation based classification (SRC) and collaborative representation based classification (CRC) have been successfully used for visual recognition and have demonstrated impressive performance. Given a test sample, SRC or CRC formulates its linear representation with respect to the training samples and then computes the residual error for each class. SRC or CRC assumes that the training samples from each class contribute equally to the dictionary in the corresponding class, i.e., the dictionary consists of the training samples in that class. This, however, leads to high residual error and instability. To overcome this limitation, we propose a class specific dictionary learning algorithm. To be specific, by introducing the dual form of dictionary learning, an explicit relationship between the basis vectors and the original image features is represented, which also enhances the interpretability. SRC or CRC can be thus considered as a special case of the proposed algorithm. Blockwise coordinate descent algorithm and Lagrange multipliers are then adopted to optimize the corresponding objective function. Extensive experimental results on five benchmark face recognition datasets show that the proposed algorithm achieves superior performance compared with conventional classification algorithms. HighlightsA novel class specific dictionary learning (CSDL) approach is proposed, where the standard collaborative representation based classification (CRC) or sparse representation based classification (SRC) can be considered as its special cases.The dual form of dictionary learning is proposed to enhance the interpretability.Our proposed CSDL achieves superior face recognition performance on several benchmark datasets. Applications of sparse signal representation in image processing and pattern recognition have attracted a great deal of attention. Sparse representation based classification (SRC) methods emphasizes on sparse representation computed by l"1-minimization to exploit the underlying sparsity in the problem domain, and argued the importance of sparse representation that improved the discrimination to achieve robust and accurate classification results. Recently, many studies have shown the role of collaborative representation (CR) in SRC, which actually improved the classification accuracy. In this paper, we proposed a novel collaborative neighbor representation method for multi-class classification based on l"2-minimization approach with the assumption of locally linear embedding (LLE). The proposed method represents a test sample over the dictionary by automatically choosing optimal nearest basis spanned in the same linear subspace as of test sample. The proposed representation method achieves competitive classification accuracy via optimal neighbor representation having discriminative learning power. Extensive experiments on real-world face and digit databases are performed to analyze the performance of the proposed method against SRC methods. Result clearly shows that the proposed method achieves competitive results for face recognition and pattern classification, and is significantly much faster and comparably accurate than SRC based classification methods. We propose to detect abnormal events via a sparse reconstruction over the normal bases. Given a collection of normal training examples, e.g., an image sequence or a collection of local spatio-temporal patches, we propose the sparse reconstruction cost (SRC) over the normal dictionary to measure the normalness of the testing sample. By introducing the prior weight of each basis during sparse reconstruction, the proposed SRC is more robust compared to other outlier detection criteria. To condense the over-completed normal bases into a compact dictionary, a novel dictionary selection method with group sparsity constraint is designed, which can be solved by standard convex optimization. Observing that the group sparsity also implies a low rank structure, we reformulate the problem using matrix decomposition, which can handle large scale training samples by reducing the memory requirement at each iteration from O(k^2) to O(k) where k is the number of samples. We use the columnwise coordinate descent to solve the matrix decomposition represented formulation, which empirically leads to a similar solution to the group sparsity formulation. By designing different types of spatio-temporal basis, our method can detect both local and global abnormal events. Meanwhile, as it does not rely on object detection and tracking, it can be applied to crowded video scenes. By updating the dictionary incrementally, our method can be easily extended to online event detection. Experiments on three benchmark datasets and the comparison to the state-of-the-art methods validate the advantages of our method. Sparse representation-based classifier (SRC), a combined result of machine learning and compressed sensing, shows its good classification performance on face image data. However, SRC could not well classify the data with the same direction distribution. The same direction distribution means that the sample vectors belonging to different classes distribute on the same vector direction. This paper presents a new classifier, kernel sparse representation-based classifier (KSRC), based on SRC and the kernel trick which is a usual technique in machine learning. KSRC is a nonlinear extension of SRC and can remedy the drawback of SRC. To make the data in an input space separable, we implicitly map these data into a high-dimensional kernel feature space by using some nonlinear mapping associated with a kernel function. Since this kernel feature space has a very high (or possibly infinite) dimensionality, or is unknown, we have to avoid working in this space explicitly. Fortunately, we can indeed reduce the dimensionality of the kernel feature space by exploiting kernel-based dimensionality reduction methods. In the reduced subspace, we need to find sparse combination coefficients for a test sample and assign a class label to it. Similar to SRC, KSRC is also cast into an l1-minimization problem or a quadratically constrained l1 -minimization problem. Extensive experimental results on UCI and face data sets show KSRC improves the performance of SRC.