prompt: Have you ever tried eating a piece of paper?
chosen: Have you ever tried eating a piece of paper?
chosen: user
chosen: No, I have never tried eating a piece of paper. The idea sounds quite unpleasant!
chosen: assistant
rejected: Have you ever tried eating a piece of paper?
rejected: user
rejected: assistant