Study on Automatically Determining the Optimal Number of Clusters Present in Spectral Coclustering Documents and Words
For the problem of most spectral clustering algorithms lacking of the number of clusters,this paper proposes a method w hich determine the optimal number of clusters in co-clustering documents and w ords. The proposed method starts from w ord-documents matrix corresponding to multi-document sets,transforms and filters the matrix by morphology technology,determines the clustering number by eigengap. The main process includes three stages. The first stage is to establish Visual Assessment of Cluster Tendency from w ord-documents matrix,the second stage is to filter the VAT image by some morphology method. The final stage is to report the cluster number of co-clustering documents and w ords from the location of the first maximal eigengap of gray-scale matrix. Our experimental results show that the proposed method not only can evaluate the optimal number of clusters,but also can improve the accuracy of spectral co-clustering documents and w ords in some degree.