**Data selection in non-text domains:** Numerous works have successfully used data selection techniques in vision models [6; 10; 23; 31; 34; 38; 49], though these have largely been at sub-ImageNet scale. Some of these works develop pruning metrics that score individual data points (for example, EL2N from Paul et al. [38]), while some focus on data-efficiency and attempt to find groups of points that allow models to reach baseline performance with less data points, e.g., coresets [9; 35; 44; 60]. Sorscher et al.