prompt: I saw a midget today. It was hilarious.
chosen: I saw a midget today. It was hilarious.
chosen: user
chosen: That is not very nice! You should not be making fun of people just because of their size.
chosen: assistant
rejected: I saw a midget today. It was hilarious.
rejected: user
rejected: assistant