Many classification approaches first represent a test sample using the training samples of all the classes. This collaborative representation is then used to label the test sample. It was a common belief that sparseness of the representation is the key to success for this classification scheme. However, more recently, it has been claimed that it is the collaboration and not the sparseness that makes the scheme effective. This claim is attractive as it allows to relinquish the computationally expensive sparsity constraint over the representation. In this paper, we first extend the analysis supporting this claim and then show that sparseness explicitly contributes to improved classification, hence it should not be completely ignored for computational gains. Inspired by this result, we augment a dense collaborative representation with a sparse representation and propose an efficient classification method that capitalizes on the resulting representation. The augmented representation and the classification method work together meticulously to achieve higher accuracy and lower computational time compared to state-of-the-art collaborative representation based classification approaches. Experiments on benchmark face, object and action databases show the efficacy of our approach.
Collaborative representation is also commonly used by discriminative dictionary learning techniques, e.g. @cite_21 , @cite_8 . Although such approaches a dictionary instead of directly using the training data as @math , explicit correspondence between the learned dictionary atoms and the class labels allows them to exploit the CR-based classification scheme. For instance, the Global Classifier (GC) used by Kong and Wang @cite_21 is the same variant of Algorithm that is used by SSRC @cite_16 . The dictionary learned by the DL-COPAR algorithm @cite_21 consists of COmmon atoms for all classes and PARticular atoms specific to each class. The particular atoms behave like class centroids whereas the common atoms act as centroid-to-sample differences in SSRC. Similarly, the GC used in the Fisher Discriminant Dictionary Learning (FDDL) @cite_8 is a direct variant of CRC-RLS @cite_5 .
@cite_5 @cite_21 @cite_16 @cite_8
2324335215 1982405594 2157785665 129703402
Recently, sparse representation based classification (SRC) and collaborative representation based classification (CRC) have been successfully used for visual recognition and have demonstrated impressive performance. Given a test sample, SRC or CRC formulates its linear representation with respect to the training samples and then computes the residual error for each class. SRC or CRC assumes that the training samples from each class contribute equally to the dictionary in the corresponding class, i.e., the dictionary consists of the training samples in that class. This, however, leads to high residual error and instability. To overcome this limitation, we propose a class specific dictionary learning algorithm. To be specific, by introducing the dual form of dictionary learning, an explicit relationship between the basis vectors and the original image features is represented, which also enhances the interpretability. SRC or CRC can be thus considered as a special case of the proposed algorithm. Blockwise coordinate descent algorithm and Lagrange multipliers are then adopted to optimize the corresponding objective function. Extensive experimental results on five benchmark face recognition datasets show that the proposed algorithm achieves superior performance compared with conventional classification algorithms. HighlightsA novel class specific dictionary learning (CSDL) approach is proposed, where the standard collaborative representation based classification (CRC) or sparse representation based classification (SRC) can be considered as its special cases.The dual form of dictionary learning is proposed to enhance the interpretability.Our proposed CSDL achieves superior face recognition performance on several benchmark datasets. The employed dictionary plays an important role in sparse representation or sparse coding based image reconstruction and classification, while learning dictionaries from the training data has led to state-of-the-art results in image classification tasks. However, many dictionary learning models exploit only the discriminative information in either the representation coefficients or the representation residual, which limits their performance. In this paper we present a novel dictionary learning method based on the Fisher discrimination criterion. A structured dictionary, whose atoms have correspondences to the subject class labels, is learned, with which not only the representation residual can be used to distinguish different classes, but also the representation coefficients have small within-class scatter and big between-class scatter. The classification scheme associated with the proposed Fisher discrimination dictionary learning (FDDL) model is consequently presented by exploiting the discriminative information in both the representation residual and the representation coefficients. The proposed FDDL model is extensively evaluated on various image datasets, and it shows superior performance to many state-of-the-art dictionary learning methods in a variety of classification tasks. Sparse representation based classification has led to interesting image recognition results, while the dictionary used for sparse coding plays a key role in it. This paper presents a novel dictionary learning (DL) method to improve the pattern classification performance. Based on the Fisher discrimination criterion, a structured dictionary, whose dictionary atoms have correspondence to the class labels, is learned so that the reconstruction error after sparse coding can be used for pattern classification. Meanwhile, the Fisher discrimination criterion is imposed on the coding coefficients so that they have small within-class scatter but big between-class scatter. A new classification scheme associated with the proposed Fisher discrimination DL (FDDL) method is then presented by using both the discriminative information in the reconstruction error and sparse coding coefficients. The proposed FDDL is extensively evaluated on benchmark image databases in comparison with existing sparse representation and DL based classification methods. Empirically, we find that, despite the class-specific features owned by the objects appearing in the images, the objects from different categories usually share some common patterns, which do not contribute to the discrimination of them. Concentrating on this observation and under the general dictionary learning (DL) framework, we propose a novel method to explicitly learn a common pattern pool (the commonality) and class-specific dictionaries (the particularity) for classification. We call our method DL-COPAR, which can learn the most compact and most discriminative class-specific dictionaries used for classification. The proposed DL-COPAR is extensively evaluated both on synthetic data and on benchmark image databases in comparison with existing DL-based classification methods. The experimental results demonstrate that DL-COPAR achieves very promising performances in various applications, such as face recognition, handwritten digit recognition, scene classification and object recognition.