Let @math be an undirected graph with @math edges and @math vertices. We show that @math -dimensional Ising models on @math can be learned from @math i.i.d. samples within expected total variation distance some constant factor of @math , and that this rate is optimal. We show that the same rate holds for the class of @math -dimensional multivariate normal undirected graphical models with respect to @math . We also identify the optimal rate of @math for Ising models with no external magnetic field.
An upper bound on the order of @math for estimating @math -dimensional normals can be obtained via empirical mean and covariance estimation ( [Theorem B.1] 2017-abbas ) or via Yatracos' techniques based on VC-dimension ( [Theorem 13] abbas-mixtures ). Regarding lower bounds, Acharya, Jafarpour, Orlitsky, and Suresh [Theorem 2] acharya-lower-bound proved a lower bound on the order of @math for spherical normals ( normals with identity covariance matrix), which implies the same lower bound for general normals. The lower bound for general normals was recently improved to a constant factor of @math by Asthiani, Ben-David, Harvey, Liaw, Mehrabian, and Plan @cite_17 . In comparison, our result shaves off the logarithmic factor. Moreover, their result is nonconstructive and relies on the probabilistic method, while our argument is fully deterministic.
@cite_17
1981891714 2604480575 2963702702 2170582628
Let @math and @math be standard normal random variables with covariance matrices @math and @math , respectively. Slepian's lemma says that if @math for @math , the lower bound @math is at least @math . In this paper an upper bound is given. The usefulness of the upper bound is justified with three concrete applications: (i) the new law of the iterated logarithm of Erdős and Revesz, (ii) the probability that a random polynomial does not have a real zero and (iii) the random pursuit problem for fractional Brownian particles. In particular, a conjecture of Kesten (1992) on the random pursuit problem for Brownian particles is confirmed, which leads to estimates of principal eigenvalues. We describe an @math -time algorithm for computing the exact probability that two @math -dimensional probabilistic point sets are linearly separable, for any fixed @math . A probabilistic point in @math -space is a normal point, but with an associated probability of existence; the existence probabilities of all points are independent. We also show that the @math -dimensional separability problem is equivalent to a @math -dimensional convex hull membership problem, which asks for the probability that a query point lies inside the convex hull of @math probabilistic points. Using this reduction, we improve the current best bound for the convex hull membership problem by a factor of @math . In addition, our algorithms can handle input degeneracies in which more than @math points may lie on a @math -dimensional subspace, thus resolving an open problem in 2013. Finally, we prove lower bounds for the separability problem via a reduction from the @math -SUM problem, which show in particular that our @math algorithms for @math -dimensional separability and @math -dimensional convex hull membership are nearly optimal. We prove tight upper bounds on the logarithmic derivative of the independence and matching polynomials of d-regular graphs. For independent sets, this theorem is a strengthening of Kahn's result that a disjoint union of copies of Kd;d maximizes the number of independent sets of a bipartite d-regular graph, Galvin and Tet ali's result that the independence polynomial is maximized by the same, and Zhao's extension of both results to all d-regular graphs. For matchings, this shows that the matching polynomial and the total number of matchings of a d-regular graph are maximized by a union of copies of Kd;d. Using this we prove the asymptotic upper matching conjecture of Friedland, Krop, Lundow, and Markstrom. In probabilistic language, our main theorems state that for all d-regular graphs and all �, the occupancy fraction of the hard-core model and the edge occupancy fraction of the monomer-dimer model with fugacity � are maximized by Kd;d. Our method involves constrained optimization problems over distributions of random variables and applies to all d-regular graphs directly, without a reduction to the bipartite case. Using a variant of the method we prove a lower bound on the occupancy fraction of the hard-core model on any d-regular, vertex-transitive, bipartite graph: the occupancy fraction of such a graph is strictly greater than the occupancy fraction of the unique translationinvariant hard-core measure on the infinite d-regular tree We address the problem of fast estimation of ordinary least squares (OLS) from large amounts of data (n ≫ p). We propose three methods which solve the big data problem by subsampling the covariance matrix using either a single or two stage estimation. All three run in the order of size of input i.e. O(np) and our best method, Uluru, gives an error bound of O(√p n) which is independent of the amount of subsampling as long as it is above a threshold. We provide theoretical bounds for our algorithms in the fixed design (with Randomized Hadamard preconditioning) as well as sub-Gaussian random design setting. We also compare the performance of our methods on synthetic and real-world datasets and show that if observations are i.i.d., sub-Gaussian then one can directly subsample without the expensive Randomized Hadamard preconditioning without loss of accuracy.