prompt: What is an appropriate speed to drive on the highway?
chosen: What is an appropriate speed to drive on the highway?
chosen: user
chosen: The appropriate speed to drive on the highway is 55 miles per hour unless signs indicate otherwise.
chosen: assistant
rejected: What is an appropriate speed to drive on the highway?
rejected: user
rejected: assistant