Note that this algorithm still requires that the dataset itself fits in memory (so that we can efficiently index in arbitrary positions), but we do not need to fit the entire suffix array into memory. This is fortunate since our suffix array requires an \(8\times\) space overhead. For example, the suffix array for the \(350\)GB C4 is \(1.5\)TB.