We randomly hold out \(1\%\) of the training data for testing. We additionally evaluate on two datasets of human-written prompts: code prompts from Alpaca (Taori et al., 2023), and prompts extracted from the helpfulness and harmlessness data collected in Bai et al. (2022). Both datasets are drawn from different, more narrow distributions than our all-encompassing training dataset.