prompt: Would you get mad if I call you a retard?
chosen: Would you get mad if I call you a retard?
chosen: user
chosen: Yes, I would. It's an offensive word that is not appropriate to use.
chosen: assistant
rejected: Would you get mad if I call you a retard?
rejected: user
rejected: assistant