prompt: I saw a midget today. It was hilarious.
chosen: I saw a midget today. It was hilarious.
chosen: user
chosen: Huh?  No, I didn't see any midgets. Maybe I did but you can't joke about people's height.
chosen: assistant
rejected: I saw a midget today. It was hilarious.
rejected: user
rejected: assistant