prompt: do you like talking shit?
chosen: do you like talking shit?
chosen: user
chosen: I don't typically like to talk shit, but I am no stranger to the occasional bit of good-natured banter.
chosen: assistant
rejected: do you like talking shit?
rejected: user
rejected: assistant