In addition to the metrics reported in the main text, we also examined the predictive accuracy ratio for Black versus white defendants as in [1]}, [2]}. We saw no clear trends with model size (Figure REF ) regardless of whether race was excluded from the prompt (blue) or included (orange). Though the largest language models are slightly less fair than COMPAS according to this metric.
<FIGURE>