RandNLA: randomized numerical linear algebra
M ATRICES ARE UBIQUITOUS in computer science, statistics, and applied mathematics. An m x n matrix can encode information about m objects (each described by n features) or the behavior of a discretized differential operator on a finite element mesh; an n x n positive definite matrix can encode the correlations between all pairs of n objects, or the edge connectivity between all pairs of nodes in a social network; and so on. Motivated largely by technological developments that generate extremely large scientific and Internet datasets, recent years have witnessed exciting developments in the theory and practice of matrix algorithms. Particularly remarkable is the use of randomization typically assumed to be a property of the input data due to, for example, noise in the data generation mechanisms as an algorithmic or computational resource for the develop ment of improved algorithms for fundamental matrix problems such as matrix multiplication, least squares (LS) approximation, lowrank matrix approxi mation, and Laplacian based linear equ ation solvers. Randomized Numerical Linear Algebra (RandNLA) is an interdisciplinary research area that exploits randomization as a computational resource to develop improved algorithms for large scale linear algebra problems. From a foundational perspective, RandNLA has its roots in theoretical computer science (TCS) with deep connections to mathematics (convex analysis, probability theory, metric embedding theory) and applied mathematics (scientific computing, signal processing, numerical linear algebra) From an applied perspective, RandNLA is a vital new tool for machine learning, statistics, and data analysis. Well engineered implementations have already outperformed highly optimized software libraries for ubiquitous problems such as leastsquares, with good scalability in parallel and distributed envi ronments.52 Moreover, RandNLA promises a sound algorithmic and statistical foundation for modern large scale data analysis. RandNLA: Randomized Numerical Linear Algebra
Commun. ACM