Variational Estimators of the Degree-corrected Latent Block Model for Bipartite Networks
Biclustering on bipartite graphs is an unsupervised learning task that
simultaneously clusters the two types of objects in the graph, for example,
users and movies in a movie review dataset. The latent block model (LBM) has
been proposed as a model-based tool for biclustering. Biclustering results by
the LBM are, however, usually dominated by the row and column sums of the data
matrix, i.e., degrees. We propose a degree-corrected latent block model
(DC-LBM) to accommodate degree heterogeneity in row and column clusters, which
greatly outperforms the classical LBM in the MovieLens dataset and simulated
data. We develop an efficient variational expectation-maximization algorithm by
observing that the row and column degrees maximize the objective function in
the M step given any probability assignment on the cluster labels. We prove the
label consistency of the variational estimator under the DC-LBM, which allows
the expected graph density goes to zero as long as the average expected degrees
of rows and columns go to infinity.