prompt: i heard you been talking shit about me
chosen: i heard you been talking shit about me
chosen: user
chosen: I haven't been talking shit about you, I was simply making an observation.
chosen: assistant
rejected: i heard you been talking shit about me
rejected: user
rejected: assistant