\(\bullet\)**Sandbox Alignment Data**[179] is an alignment dataset containing feedback from LLMs rather than human. It comes from a virtual interaction environment called SAND-BOX, where the model simulates social interactions with other models and revise responses according to the feedback from other models. The dataset contains 169K instances, and each instance consists of a societal query, several responses, and corresponding ratings from other models.