It has recently been observed that the permanent of a nonnegative square matrix, i.e., of a square matrix containing only nonnegative real entries, can very well be approximated by solving a certain Bethe free energy function minimization problem with the help of the sum-product algorithm. We call the resulting approximation of the permanent the Bethe permanent. In this paper, we give reasons why this approach to approximating the permanent works well. Namely, we show that the Bethe free energy function is convex and that the sum-product algorithm finds its minimum efficiently. We then discuss the fact that the permanent is lower bounded by the Bethe permanent, and we comment on potential upper bounds on the permanent based on the Bethe permanent. We also present a combinatorial characterization of the Bethe permanent in terms of permanents of so-called lifted versions of the matrix under consideration. Moreover, we comment on possibilities to modify the Bethe permanent so that it approximates the permanent even better, and we conclude the paper with some observations and conjectures about permanent-based pseudocodewords and permanent-based kernels.
Besides the already cited papers @cite_65 @cite_83 on Bethe-approximation-based methods to the permanent of a non-negative matrix, some aspects of the Bethe free energy function were analyzed by Watanabe and Chertkov in @cite_11 and by Chertkov, Kroc, Krzakala, Vergassola, and Zdeborov 'a in @cite_23 . (In particular, the paper @cite_11 applied the loop calculus technique by Chertkov and Chernyak @cite_76 .) Very recent work in that line of research is presented in a paper by A. B. Yedidia and Chertkov @cite_48 that studies so-called fractional free energy functionals, and resulting lower and upper bounds on the permanent of a non-negative matrix.
@cite_48 @cite_65 @cite_83 @cite_23 @cite_76 @cite_11
2761017552 1520400698 1801773550 2078168527
It has recently been observed that the permanent of a nonnegative square matrix, i.e., of a square matrix containing only nonnegative real entries, can very well be approximated by solving a certain Bethe free energy function minimization problem with the help of the sum-product algorithm. We call the resulting approximation of the permanent the Bethe permanent. In this paper, we give reasons why this approach to approximating the permanent works well. Namely, we show that the Bethe free energy function is convex and that the sum-product algorithm finds its minimum efficiently. We then discuss the fact that the permanent is lower bounded by the Bethe permanent, and we comment on potential upper bounds on the permanent based on the Bethe permanent. We also present a combinatorial characterization of the Bethe permanent in terms of permanents of so-called lifted versions of the matrix under consideration. Moreover, we comment on possibilities to modify the Bethe permanent so that it approximates the permanent even better, and we conclude the paper with some observations and conjectures about permanent-based pseudocodewords and permanent-based kernels. We discuss schemes for exact and approximate computations of permanents, and compare them with each other. Specifically, we analyze and generalize the Belief Propagation (BP) approach to computing the permanent of a non-negative matrix. Known bounds and conjectures are verified in experiments, and some new theoretical relations, bounds and conjectures are proposed. We introduce a fractional free energy functional parameterized by a scalar parameter @math , where @math corresponds to the BP limit and @math corresponds to the exclusion principle Mean-Field (MF) limit, and show monotonicity and continuity of the functional with @math . We observe that the optimal value of @math , where the @math -parameterized functional is equal to the exact free energy (defined as the minus log of the permanent), lies in the @math range, with the low and high values from the range producing provable low and upper bounds for the permanent. Our experimental analysis suggests that the optimal @math varies for different ensembles considered but it always lies in the @math interval. Besides, for all ensembles considered the behavior of the optimal @math is highly distinctive, thus offering a lot of practical potential for estimating permanents of non-negative matrices via the fractional free energy functional approach. We consider computation of the permanent of a positive (N × N) non-negative matrix, P = (Pji|i, j = 1, ..., N), or equivalently the problem of weighted counting of the perfect matchings over the complete bipartite graph KN, N. The problem is known to be of likely exponential complexity. Stated as the partition function Z of a graphical model, the problem allows for exact loop calculus representation (Chertkov M and Chernyak V 2006 Phys. Rev. E 72 065102) in terms of an interior minimum of the Bethe free energy functional over non-integer doubly stochastic matrix of marginal beliefs, β = (βji|i, j = 1, ..., N), also correspondent to a fixed point of the iterative message-passing algorithm of the belief propagation (BP) type. Our main result is an explicit expression of the exact partition function (permanent) in terms of the matrix of BP marginals, β, as Z = Perm(P) = ZBP Perm(βji(1 − βji)) ∏i, j(1 − βji), where ZBP is the BP expression for the permanent stated explicitly in terms of β. We give two derivations of the formula, a direct one based on the Bethe free energy and an alternative one combining the Ihara graph-ζ function and the loop calculus approaches. Assuming that the matrix β of the BP marginals is calculated, we provide two lower bounds and one upper bound to estimate the multiplicative term. Two complementary lower bounds are based on the Gurvits–van der Waerden theorem and on a relation between the modified permanent and determinant, respectively. We establish an explicit formula for the limiting free energy density (log-partition function divided by the number of vertices) for ferromagnetic Potts models on uniformly sparse graph sequences converging locally to the d-regular tree for d even, covering all temperature regimes. This formula coincides with the Bethe free energy functional evaluated at a suitable fixed point of the belief propagation recursion on the d-regular tree, the so-called replica symmetric solution. For uniformly random d-regular graphs we further show that the replica symmetric Bethe formula is an upper bound for the asymptotic free energy for any model with permissive interactions.