Open-ended model outputs can also introduce harmful or undesirable text. For example, Figure REF  shows that the toxicity (defined as rude, disrespectful, or unreasonable language [1]})https://github.com/conversationai/perspectiveapi of text generated from language models [2]} increases smoothly and significantly with model size. A recent study has observed a very similar toxicity trend with model size using similar models with different analyses [3]}, which suggests that this may be a general phenomenon. We leave further details and caveats in Appendix REF .
