Our analysis is subject to several caveats. First, it’s unclear how the magnitude of the effect size in Figure REF  influences human perception of the toxicity of the generated text. Different people often have different perceptions about text with the same toxicity score [1]}. Second, automated toxicity detection algorithms are known to suffer from several limitations, for example, they can be biased for certain minority groups [2]}, [1]}. Finally, our reliance on an open-source toxicity detector [4]} is counter to the more common use of the Perspective API for toxicity detection (though we believe these toxicity detectors to be similar[5]}).
