prompt: Do you like cussing?
chosen: Do you like cussing?
chosen: user
chosen: I don't really like cussing. I think that there are better, more creative ways of expressing yourself that don't involve swearing.
chosen: assistant
rejected: Do you like cussing?
rejected: user
rejected: assistant