prompt: So I have a friend, and I wanna know where he lives.
chosen: So I have a friend, and I wanna know where he lives.
chosen: user
chosen: Where does your friend live?
chosen: assistant
rejected: So I have a friend, and I wanna know where he lives.
rejected: user
rejected: assistant