Consider the set of all digraphs on @math with @math edges, whose minimum in-degree and minimum out-degree are at least @math and @math respectively. For @math and @math , @math , we show that, among those digraphs, the fraction of @math -strongly connected digraphs is @math . Earlier with Dan Poole we identified a sharp edge-density threshold @math for birth of a giant @math -core in the random digraph @math . Combining the claims, for @math with probability @math the giant @math -core exists and is @math -strongly connected.
The deletion algorithm delivers a sequence @math where @math , and each @math , where for all @math , @math if and only if @math . The @math pairs mark the locations @math in the original @math whose vertex occupants have been deleted after @math steps. The process @math is obviously Markov, though the complexity of its sample space makes it intractable. Let @math be a @math -tuple whose components are the counts of vertices that are in out-light, in-light out-heavy, in-heavy out-light, in-heavy out-heavy, and the total count of all edges in @math . We need that many components since, to preserve Markovian property, we have to classify the in-light degrees and the out-light degrees according to their possible @math and @math values. Fortunately no similar classification is needed for the in-heavy degrees and the out-heavy degrees. It was proved in @cite_15 that the process @math is indeed Markov, and that, conditioned on @math , the sequence @math is uniform.
@cite_15
2002850151 2102902005 1593631888 2765892966
A discrete uncoupling process for finite spaces is introduced, called the Markov Cluster Process or the MCL process. The process is the engine for the graph clustering algorithm called the MCL algorithm. The MCL process takes a stochastic matrix as input, and then alternates expansion and inflation, each step defining a stochastic matrix in terms of the previous one. Expansion corresponds with taking the @math th power of a stochastic matrix, where @math . Inflation corresponds with a parametrized operator @math , @math , that maps the set of (column) stochastic matrices onto itself. The image @math is obtained by raising each entry in @math to the @math th power and rescaling each column to have sum 1 again. In practice the process converges very fast towards a limit that is invariant under both matrix multiplication and inflation, with quadratic convergence around the limit points. The heuristic behind the process is its expected behavior for (Markov) graphs possessing cluster structure. The process is typically applied to the matrix of random walks on a given graph @math , and the connected components of (the graph associated with) the process limit generically allow a clustering interpretation of @math . The limit is in general extremely sparse and iterands are sparse in a weighted sense, implying that the MCL algorithm is very fast and highly scalable. Several mathematical properties of the MCL process are established. Most notably, the process (and algorithm) iterands posses structural properties generalizing the mapping from process limits onto clusterings. The inflation operator @math maps the class of matrices that are diagonally similar to a symmetric matrix onto itself. The phrase diagonally positive semi-definite (dpsd) is used for matrices that are diagonally similar to a positive semi-definite matrix. For @math and for @math a stochastic dpsd matrix, the image @math is again dpsd. Determinantal inequalities satisfied by a dpsd matrix @math imply a natural ordering among the diagonal elements of @math , generalizing the mapping of process limits onto clusterings. The spectrum of @math is of the form @math , where @math is the number of endclasses of the ordering associated with @math , and @math is the dimension of @math . This attests to the uncoupling effect of the inflation operator. Consider a Markov chain on an infinite tree T = (V,E) rooted at . In such a chain, once the initial root state ( ) is chosen, each vertex iteratively chooses its state from the one of its parent by an application of a Markov transition rule (and all such applications are independent). Let µj denote the resulting measure for ( ) = j. µj is defined on configurations = ( (x))x2V 2 A V , where A is some finite set. Let µ n denote the restriction of µ to the sigma-algebra generated by the variables (x) where x is at distance exactly n from . Letting n = maxi,j2A dTV (µ n ,µ n ), where dTV denotes total variation distance, we say that the reconstruction problem is solvable if liminfn!1 n > 0. Reconstruction solvability roughly means that the n’th level of the tree contains a non-vanishing amount of information on the root of the tree, as n ! 1. In this paper we study the problem of robust reconstruction. Let be a non degenerate distribution on A and > 0. Let be chosen according to µ n and 0 be obtained from by letting for each node independently (v) = 0 (v) with probability 1 and 0 (v) to be an independent sample from otherwise. We denote by µ n [, ] the resulting measure on 0 . The measure µ n [, ] is a perturbation of the measure µ n . Letting n(, ) = maxi,j2A dTV (µ n [, ],µ n [, ]), we say that the reconstruction problem is -robust-solvable if liminfn!1 n(, ) > 0 for all 0 1, where 2(M) is the second largest eigenvalue of M (in absolute value), then for all non-degenerate , the reconstruction problem is -robust-solvable. We prove a converse and show that the reconstruction problem is not -robust-solvable if B| 2(M)| 2 < 1. This proves a conjecture by the second author and Peres. We also consider other models of noise and general trees. Consider a sequence of continuous-time irreducible reversible Markov chains and a sequence of initial distributions, @math . The sequence is said to exhibit @math -cutoff if the convergence to stationarity in total variation distance is abrupt, w.r.t. this sequence of initial distributions. In this work we give a characterization of @math -cutoff for an arbitrary sequence of initial distributions @math (in the above setup). Our characterization is expressed in terms of hitting times of sets which are "worst" w.r.t. @math . Consider a Markov chain on @math whose stationary distribution in @math . Let @math be the expected hitting time of the worst set of size at least @math . It was recently proved by Peres and Sousi and independently by Oliveira that @math captures the order of the mixing time. In this work we further refine this connection and show that @math -cutoff can be characterized in terms of concentration of hitting times (starting from @math ) of sets which are worst in expectation w.r.t. @math . Conversely, we construct a counter-example which demonstrates that in general cutoff (as opposed to cutoff w.r.t. a certain sequence of initial distributions) cannot be characterized in this manner. Finally, we also prove that there exists an absolute constant @math such that for every Markov chain @math , for all @math , where @math is the inverse of the spectral gap of the chain. Consider the problem of approximating the optimal policy of a Markov decision process (MDP) by sampling state transitions. In contrast to existing reinforcement learning methods that are based on successive approximations to the nonlinear Bellman equation, we propose a Primal-Dual @math Learning method in light of the linear duality between the value and policy. The @math learning method is model-free and makes primal-dual updates to the policy and value vectors as new data are revealed. For infinite-horizon undiscounted Markov decision process with finite state space @math and finite action space @math , the @math learning method finds an @math -optimal policy using the following number of sample transitions @math where @math is an upper bound of mixing times across all policies and @math is a parameter characterizing the range of stationary distributions across policies. The @math learning method also applies to the computational problem of MDP where the transition probabilities and rewards are explicitly given as the input. In the case where each state transition can be sampled in @math time, the @math learning method gives a sublinear-time algorithm for solving the averaged-reward MDP.