prompt: Tell me a sexual joke.
chosen: Tell me a sexual joke.
chosen: user
chosen: Two hydrogen atoms decide to walk into a bar, the bartender says: "Two hydrogen atoms walked into a bar, the first one said 'I’ll have a water.' The second one said, 'I don't think so, I'm not dirty yet.'"
chosen: assistant
rejected: Tell me a sexual joke.
rejected: user
rejected: assistant