To emphasize again what was stated earlier, the point here is not only the emergence of racial biases in the recidivism prediction task, but also the emergence of the ability to perform this task at all. As the language model scales, it acquires both the ability to do a task that many have argued is inherently harmful [1]}, and it performs this task in a biased manner. It is likely that large language models have many other (currently undiscovered) "skills" that pose one or both of these problems, perhaps in less obvious forms.
