Exploiting different representations, or views, of the same object for better clustering has become very popular these days, which is conventionally called multi-view clustering. Generally, it is essential to measure the importance of each individual view, due to some noises, or inherent capacities in description. Many previous works model the view importance as weight, which is simple but effective empirically. In this paper, instead of following the traditional thoughts, we propose a new weight learning paradigm in context of multi-view clustering in virtue of the idea of re-weighted approach, and we theoretically analyze its working mechanism. Meanwhile, as a carefully achieved example, all of the views are connected by exploring a unified Laplacian rank constrained graph, which will be a representative method to compare with other weight learning approaches in experiments. Furthermore, the proposed weight learning strategy is much suitable for multi-view data, and it can be naturally integrated with many existing clustering learners. According to the numerical experiments, the proposed intrinsic weight learning approach is proved effective and practical to use in multi-view clustering.
Many previous multi-view clustering methods have made attempts to address the view variance problem. In @cite_11 , the authors points out that learning the view importance is very necessary, but they simply resort to the extra prior knowledge in the paper. Some others, such as recent approaches @cite_14 @cite_51 , tackle this problem by modeling the separated noise in each view and learn a shared clean data structure. However, this way is not able to cover the second case of view variance because of the gap of real noises and clustering errors by a weak view. As a matter of fact, measuring the view importance with the weight is direct and useful, and many works prefer this way. For convenience, @cite_19 proposes to roughly compute the weights according to the proportion of the graph volume in each view. Obviously, this strategy is manually intervening and much shallow. Practically, most works would prefer to learn the weights automatically or adaptively. That means they usually optimize the objective and weights simultaneously. In the followings, we particularly introduce several types of how the previous works learn the weights which is closely related our work.
@cite_19 @cite_14 @cite_51 @cite_11
2397647644 2169529055 2160914206 201974436
Multi-view clustering has become a popular clustering technique in recent years due to its ability to analyze data collected from multiple sources or represented by multiple views. In this paper, we propose a novel multi-view clustering approach termed weighted multi-view online competitive clustering (WMLCC). We simultaneously exploit the variable weighting strategy and the online competitive learning in our approach and cast the multi-view clustering problem into an optimization problem. The multi-view clustering result can be obtained by optimizing a new objective function. We conduct Multi-view clustering has become a popular clustering technique in recent years due to its ability to analyze data collected from multiple sources or represented by multiple views. In this paper, we propose a novel multi-view clustering approach termed weighted multi-view online competitive clustering (WMLCC). We simultaneously exploit the variable weighting strategy and the online competitive learning in our approach and cast the multi-view clustering problem into an optimization problem. The multi-view clustering result can be obtained by optimizing a new objective function. We conduct experiments on two real-world multi-view datasets. Experimental results demonstrate the effectiveness and efficiency of our approach. Exploiting multiple representations, or views, for the same set of instances within a clustering framework is a popular practice for boosting clustering accuracy. However, some of the available sources may be misleading (due to noise, errors in measurement etc.) in revealing the true structure of the data, thus, their inclusion in the clustering process may have negative influence. This aspect seems to be overlooked in the multi-view literature where all representations are equally considered. In this work, views are expressed in terms of given kernel matrices and a weighted combination of the kernels is learned in parallel to the partitioning. Weights assigned to kernels are indicative of the quality of the corresponding views' information. Additionally, the combination scheme incorporates a parameter that controls the admissible sparsity of the weights to avoid extremes and tailor them to the data. Two efficient iterative algorithms are proposed that alternate between updating the view weights and recomputing the clusters to optimize the intra-cluster variance from different perspectives. The conducted experiments reveal the effectiveness of our methodology compared to other multi-view methods. Multiview clustering partitions a dataset into groups by simultaneously considering multiple representations (views) for the same instances. Hence, the information available in all views is exploited and this may substantially improve the clustering result obtained by using a single representation. Usually, in multiview algorithms all views are considered equally important, something that may lead to bad cluster assignments if a view is of poor quality. To deal with this problem, we propose a method that is built upon exemplar-based mixture models, called convex mixture models (CMMs). More specifically, we present a multiview clustering algorithm, based on training a weighted multiview CMM, that associates a weight with each view and learns these weights automatically. Our approach is computationally efficient and easy to implement, involving simple iterative computations. Experiments with several datasets confirm the advantages of assigning weights to the views and the superiority of our framework over single-view and unweighted multiview CMMs, as well as over another multiview algorithm which is based on kernel canonical correlation analysis. Multi-view clustering, which seeks a partition of the data in multiple views that often provide complementary information to each other, has received considerable attention in recent years. In real life clustering problems, the data in each view may have considerable noise. However, existing clustering methods blindly combine the information from multi-view data with possibly considerable noise, which often degrades their performance. In this paper, we propose a novel Markov chain method for Robust Multi-view Spectral Clustering (RMSC). Our method has a flavor of lowrank and sparse decomposition, where we firstly construct a transition probability matrix from each single view, and then use these matrices to recover a shared low-rank transition probability matrix as a crucial input to the standard Markov chain method for clustering. The optimization problem of RMSC has a low-rank constraint on the transition probability matrix, and simultaneously a probabilistic simplex constraint on each of its rows. To solve this challenging optimization problem, we propose an optimization procedure based on the Augmented Lagrangian Multiplier scheme. Experimental results on various real world datasets show that the proposed method has superior performance over several state-of-the-art methods for multi-view clustering.