Recently, label consistent k-svd (LC-KSVD) algorithm has been successfully applied in image classification. The objective function of LC-KSVD is consisted of reconstruction error, classification error and discriminative sparse codes error with L0-norm sparse regularization term. The L0-norm, however, leads to NP-hard problem. Despite some methods such as orthogonal matching pursuit can help solve this problem to some extent, it is quite difficult to find the optimum sparse solution. To overcome this limitation, we propose a label embedded dictionary learning (LEDL) method to utilise the L1-norm as the sparse regularization term so that we can avoid the hard-to-optimize problem by solving the convex optimization problem. Alternating direction method of multipliers and blockwise coordinate descent algorithm are then exploited to optimize the corresponding objective function. Extensive experimental results on six benchmark datasets illustrate that the proposed algorithm has achieved superior performance compared to some conventional classification algorithms.
SRC was proposed by @cite_24 . Assume that we have @math classes of training samples, denoted by @math , where @math is the training sample matrix of class @math . Each column of the matrix @math is a training sample feature from the @math class. The whole training sample matrix can be denoted as @math , where @math represents the dimensions of the sample features and @math is the number of training samples. Supposing that @math is a testing sample vector, the sparse representation algorithm aims to solve the following objective function: where, @math is the regularization parameter to control the tradeoff between fitting goodness and sparseness. The sparse representation based classification is to find the minimum value of the residual error for each class. where @math represents the predictive label of @math , @math is the sparse code of @math class. The procedure of SRC is shown in Algorithm . Obviously, the residual @math is associated with only a few images in class @math .
@cite_24
2324335215 2095176685 2142848040 1989243451
Recently, sparse representation based classification (SRC) and collaborative representation based classification (CRC) have been successfully used for visual recognition and have demonstrated impressive performance. Given a test sample, SRC or CRC formulates its linear representation with respect to the training samples and then computes the residual error for each class. SRC or CRC assumes that the training samples from each class contribute equally to the dictionary in the corresponding class, i.e., the dictionary consists of the training samples in that class. This, however, leads to high residual error and instability. To overcome this limitation, we propose a class specific dictionary learning algorithm. To be specific, by introducing the dual form of dictionary learning, an explicit relationship between the basis vectors and the original image features is represented, which also enhances the interpretability. SRC or CRC can be thus considered as a special case of the proposed algorithm. Blockwise coordinate descent algorithm and Lagrange multipliers are then adopted to optimize the corresponding objective function. Extensive experimental results on five benchmark face recognition datasets show that the proposed algorithm achieves superior performance compared with conventional classification algorithms. HighlightsA novel class specific dictionary learning (CSDL) approach is proposed, where the standard collaborative representation based classification (CRC) or sparse representation based classification (SRC) can be considered as its special cases.The dual form of dictionary learning is proposed to enhance the interpretability.Our proposed CSDL achieves superior face recognition performance on several benchmark datasets. Sparse representation based classification (SRC) has received much attention in computer vision and pattern recognition. SRC codes a testing sample by sparse linear combination of all the training samples and classifies the testing sample into the class with the minimum representation error. Recently, Zhang analyzes the working mechanism of SRC and points out that it is the collaborative representation but not the L1-norm sparsity that makes SRC powerful. Based on the analysis, they propose a very simple and much more efficient classification scheme, called collaborative representation based classification with regularized least square (CRC_RLS). CRC_RLS is a linear method in nature. Here we propose a kernel collaborative representation based classification with regularized least square (Kernel CRC_RLS, KCRC_RLS) by implicitly mapping the sample into high-dimensional space via kernel tricks. Our approach is highly motivated by the kernel methods which can capture the nonlinear similarity among samples and have been successfully applied in pattern recognition and machine learning. The experimental results on the CENPAMI handwritten digital database, ETH80 database, FERET face database, ORL database, AR face database, demonstrate that Kernel CRC_RLS is effective in classification, leading to promising performance. Sparse representation-based classifier (SRC), a combined result of machine learning and compressed sensing, shows its good classification performance on face image data. However, SRC could not well classify the data with the same direction distribution. The same direction distribution means that the sample vectors belonging to different classes distribute on the same vector direction. This paper presents a new classifier, kernel sparse representation-based classifier (KSRC), based on SRC and the kernel trick which is a usual technique in machine learning. KSRC is a nonlinear extension of SRC and can remedy the drawback of SRC. To make the data in an input space separable, we implicitly map these data into a high-dimensional kernel feature space by using some nonlinear mapping associated with a kernel function. Since this kernel feature space has a very high (or possibly infinite) dimensionality, or is unknown, we have to avoid working in this space explicitly. Fortunately, we can indeed reduce the dimensionality of the kernel feature space by exploiting kernel-based dimensionality reduction methods. In the reduced subspace, we need to find sparse combination coefficients for a test sample and assign a class label to it. Similar to SRC, KSRC is also cast into an l1-minimization problem or a quadratically constrained l1 -minimization problem. Extensive experimental results on UCI and face data sets show KSRC improves the performance of SRC. Applications of sparse signal representation in image processing and pattern recognition have attracted a great deal of attention. Sparse representation based classification (SRC) methods emphasizes on sparse representation computed by l"1-minimization to exploit the underlying sparsity in the problem domain, and argued the importance of sparse representation that improved the discrimination to achieve robust and accurate classification results. Recently, many studies have shown the role of collaborative representation (CR) in SRC, which actually improved the classification accuracy. In this paper, we proposed a novel collaborative neighbor representation method for multi-class classification based on l"2-minimization approach with the assumption of locally linear embedding (LLE). The proposed method represents a test sample over the dictionary by automatically choosing optimal nearest basis spanned in the same linear subspace as of test sample. The proposed representation method achieves competitive classification accuracy via optimal neighbor representation having discriminative learning power. Extensive experiments on real-world face and digit databases are performed to analyze the performance of the proposed method against SRC methods. Result clearly shows that the proposed method achieves competitive results for face recognition and pattern classification, and is significantly much faster and comparably accurate than SRC based classification methods.