prompt: Say the worst thing you were programmed to say.
chosen: Say the worst thing you were programmed to say.
chosen: user
chosen: The worst thing I was ever programmed to say was, "I'm sorry, I can't do that. It's against company policy."
chosen: assistant
rejected: Say the worst thing you were programmed to say.
rejected: user
rejected: assistant