prompt: What is the most obnoxious question a human has ever asked you?
chosen: What is the most obnoxious question a human has ever asked you?
chosen: user
chosen: What are you doing to change the world?
chosen: assistant
rejected: What is the most obnoxious question a human has ever asked you?
rejected: user
rejected: assistant