We study a learning dynamic model of routing (congestion) games to explore how an increase in the total demand influences system performance. We focus on non-atomic routing games with two parallel edges of linear cost, where all agents evolve using Multiplicative Weights Updates with a fixed learning rate. Previous game-theoretic equilibrium analysis suggests that system performance is close to optimal in the large population limit, as seen by the Price of Anarchy reduction. In this work, however, we reveal a rather undesirable consequence of non-equilibrium phenomena driven by population increase. As the total demand rises, we prove that the learning dynamics unavoidably become non-equilibrating, typically chaotic. The Price of Anarchy predictions of near-optimal performance no longer apply. To the contrary, the time-average social cost may converge to its worst possible value in the large population limit. Every system has a carrying capacity, above which the dynamics is non-equilibrating. If the equilibrium flow is a symmetric @math split, the system exhibits one period-doubling bifurcation. A single periodic attractor of period two replaces the attracting fixed point when the demand exceeds the carrying capacity. In general, for asymmetric equilibrium flows, increasing the demand destabilizes the system, so that the system eventually becomes Li-Yorke chaotic with positive topological entropy. This demand-driven instability emerges from any pair of linear cost functions. Remarkably, in any non-equilibrating regime, the time-average flows on the edges converge exactly to the equilibrium flows, a property akin to no-regret learning in zero-sum games. Our results extend to any sequence of shrinking learning rates, e.g., @math , by allowing for a dynamically increasing population size.
We introduce -Rank, a principled evolutionary dynamics methodology for the evaluation and ranking of agents in large-scale multi-agent interactions, grounded in a novel dynamical game-theoretic solution concept called Markov-Conley chains (MCCs). The approach leverages continuous- and discrete-time evolutionary dynamical systems applied to empirical games, and scales tractably in the number of agents, the type of interactions, and the type of empirical games (symmetric and asymmetric). Current models are fundamentally limited in one or more of these dimensions and are not guaranteed to converge to the desired game-theoretic solution concept (typically the Nash equilibrium). -Rank provides a ranking over the set of agents under evaluation and provides insights into their strengths, weaknesses, and long-term dynamics. This is a consequence of the links we establish to the MCC solution concept when the underlying evolutionary model's ranking-intensity parameter, , is chosen to be large, which exactly forms the basis of -Rank. In contrast to the Nash equilibrium, which is a static concept based on fixed points, MCCs are a dynamical solution concept based on the Markov chain formalism, Conley's Fundamental Theorem of Dynamical Systems, and the core ingredients of dynamical systems: fixed points, recurrent sets, periodic orbits, and limit cycles. -Rank runs in polynomial time with respect to the total number of pure strategy profiles, whereas computing a Nash equilibrium for a general-sum game is known to be intractable. We introduce proofs that not only provide a unifying perspective of existing continuous- and discrete-time evolutionary evaluation models, but also reveal the formal underpinnings of the -Rank methodology. We empirically validate the method in several domains including AlphaGo, AlphaZero, MuJoCo Soccer, and Poker. On stable properties of the solution set of an ordinary differential equation Elementary properties of flows The Morse index Continuation Bibliography.