Using random subsamples this way is common in machine learning, including bias detection studies <cite>(Elazar and Goldberg, 2018</cite>; Zhao et al., 2019) and probing studies (Ravfogel et al., 2018; Lin et al., 2019) , but is known to overestimate performance (Globerson and Roweis, 2016), in particular for highdimensional problems.