@inproceedings{
coles2023thermodynamic,
title={Thermodynamic {AI} and Thermodynamic Linear Algebra},
author={Patrick J. Coles and Maxwell Aifer and Kaelan Donatella and Denis Melanson and Max Hunter Gordon and Thomas Dybdahl Ahle and Daniel Simpson and Gavin Crooks and Antonio J Martinez and Faris Mouti Sbahi},
booktitle={Machine Learning with New Compute Paradigms},
year={2023},
url={https://openreview.net/forum?id=6flkWTzK2H}
}
Many Artificial Intelligence (AI) algorithms are inspired by physics and employ stochastic fluctuations, such as generative diffusion models, Bayesian neural networks, and Monte Carlo inference. These algorithms are currently run on digital hardware, ultimately limiting their scalability and overall potential. Here, we propose a novel computing device, called Thermodynamic AI hardware, that could accelerate such algorithms. Thermodynamic AI hardware can be viewed as a novel form of computing, since it uses novel fundamental building blocks, called stochastic units (s-units), which naturally evolve over time via stochastic trajectories. In addition to these s-units, Thermodynamic AI hardware employs a Maxwell's demon device that guides the system to produce non-trivial states. We provide a few simple physical architectures for building these devices, such as RC electrical circuits. Moreover, we show that this same hardware can be used to accelerate various linear algebra primitives. We present simple thermodynamic algorithms for (1) solving linear systems of equations, (2) computing matrix inverses, (3) computing matrix determinants, and (4) solving Lyapunov equations. Under reasonable assumptions, we rigorously establish asymptotic speedups for our algorithms, relative to digital methods, that scale linearly in dimension. Numerical simulations also suggest a speedup is achievable in practical scenarios.
Thermodynamic AI and Thermodynamic Linear Algebra
Patrick J. Coles Maxwell Aifer Kaelan Donatella Denis Melanson Max Hunter Gordon Thomas Dybdahl Ahle Daniel Simpson Gavin Crooks Antonio J Martinez Faris Mouti Sbahi