Complexity and unpredictabilityAI systems can accept a huge number of potential inputs and return a vast number of potential outputs. For instance, most LMs now have context windows of 4,000 tokens, and in some cases up to 200,000 or more--which is typically \(150+\) pages of text. Models often consist of billions of tunable parameters, each of which exerts some difficult-to-reason-about impact on the model's overall behavior. Furthermore, even when hyperparameters are set so that models' output is more deterministic (e.g., setting a low temperature), model responses are still probabilistic and conditioned on inputs. This can be a great strength as it allows for creative hallucinations and emergent behavior, such as reasoning about abstract concepts or creating novel content.25 However, it also makes it difficult to predict their behavior and ensure that none of their responses are unsafe.