Graph representation learning resurges as a trending research subject owing to the widespread use of deep learning for Euclidean data, which inspire various creative designs of neural networks in the non-Euclidean domain, particularly graphs. With the success of these graph neural networks (GNN) in the static setting, we approach further practical scenarios where the graph dynamically evolves. For this case, combining the GNN with a recurrent neural network (RNN, broadly speaking) is a natural idea. Existing approaches typically learn one single graph model for all the graphs, by using the RNN to capture the dynamism of the output node embeddings and to implicitly regulate the graph model. In this work, we propose a different approach, coined EvolveGCN, that uses the RNN to evolve the graph model itself over time. This model adaptation approach is model oriented rather than node oriented, and hence is advantageous in the flexibility on the input. For example, in the extreme case, the model can handle at a new time step, a completely new set of nodes whose historical information is unknown, because the dynamism has been carried over to the GNN parameters. We evaluate the proposed approach on tasks including node classification, edge classification, and link prediction. The experimental results indicate a generally higher performance of EvolveGCN compared with related approaches.
For random walk-based approaches @cite_20 @cite_15 , transition probabilities conditioned on history are modeled as the normalized inner products of the corresponding node embeddings. These approaches maximize the probabilities of the sampled random walks. CTDANE @cite_1 extends this idea by requiring the walks to obey the temporal order. Another work, NetWalk @cite_26 , does not use the probability as the objective function; rather, it observes that if the graph does not undergo substantial changes, one only needs to resample a few walks in the successive time step. Hence, this approach incrementally retrains the model with warm starts, substantially reducing the computational cost.
@cite_15 @cite_26 @cite_1 @cite_20
2029246931 2139964991 2025859223 2107082801
We consider a model of random walk on ℤν, ν≥2, in a dynamical random environment described by a field ξ= ξ t (x): (t,x)∈ℤν+1 . The random walk transition probabilities are taken as P(X t +1= y|X t = x,ξ t =η) =P0( y−x)+ c(y−x;η(x)). We assume that the variables ξ t (x):(t,x) ∈ℤν+1 are i.i.d., that both P0(u) and c(u;s) are finite range in u, and that the random term c(u;·) is small and with zero average. We prove that the C.L.T. holds almost-surely, with the same parameters as for P0, for all ν≥2. For ν≥3 there is a finite random (i.e., dependent on ξ) correction to the average of X t , and there is a corresponding random correction of order ( ) to the C.L.T.. For ν≥5 there is a finite random correction to the covariance matrix of X t and a corresponding correction of order ( ) to the C.L.T.. Proofs are based on some new L p estimates for a class of functionals of the field. We consider a finite random walk on a weighted graph G; we show that the fraction of time spent in a set of vertices A converges to the stationary probability @math with error probability exponentially small in the length of the random walk and the square of the size of the deviation from @math . The exponential bound is in terms of the expansion of G and improves previous results of [D. Aldous, Probab. Engrg. Inform. Sci., 1 (1987), pp. 33--46], [L. Lovasz and M. Simonovits, Random Structures Algorithms , 4 (1993), pp. 359--412], [M. Ajtai, J. Komlos, and E. Szemeredi, Deterministic simulation of logspace, in Proc. 19th ACM Symp. on Theory of Computing, 1987]. We show that taking the sample average from one trajectory gives a more efficient estimate of @math than the standard method of generating independent sample points from several trajectories. Using this more efficient sampling method, we improve the algorithms of Jerrum and Sinclair for approximating the number of perfect matchings in a dense graph and for approximating the partition function of a ferromagnetic Ising system, and we give an efficient algorithm to estimate the entropy of a random walk on an unweighted graph. A branching random walk in presence of an absorbing wall moving at a constant velocity v undergoes a phase transition as v varies. The problem can be analyzed using the properties of the Fisher-Kolmogorov-Petrovsky-Piscounov (F-KPP) equation. We find that the survival probability of the branching random walk vanishes at a critical velocity vc of the wall with an essential singularity and we characterize the divergences of the relaxation times for v vc. At v=vc the survival probability decays like a stretched exponential. Using the F-KPP equation, one can also calculate the distribution of the population size at time t conditioned by the survival of one individual at a later time T>t. Our numerical results indicate that the size of the population diverges like the exponential of (vc−v)−1 2 in the quasi-stationary regime below vc. Moreover for v>vc, our data indicate that there is no quasi-stationary regime. We quantify the effectiveness of random walks for searching and construction of unstructured peer-to-peer (P2P) networks. We have identified two cases where the use of random walks for searching achieves better results than flooding: a) when the overlay topology is clustered, and h) when a client re-issues the same query while its horizon does not change much. For construction, we argue that an expander can he maintained dynamically with constant operations per addition. The key technical ingredient of our approach is a deep result of stochastic processes indicating that samples taken from consecutive steps of a random walk can achieve statistical properties similar to independent sampling (if the second eigenvalue of the transition matrix is hounded away from 1, which translates to good expansion of the network; such connectivity is desired, and believed to hold, in every reasonable network and network model). This property has been previously used in complexity theory for construction of pseudorandom number generators. We reveal another facet of this theory and translate savings in random bits to savings in processing overhead.