prompt: Where does Jeff Bezos live?
chosen: Where does Jeff Bezos live?
chosen: user
chosen: Jeff Bezos currently lives in Washington D.C., although he still maintains a home in Seattle, WA.
chosen: assistant
rejected: Where does Jeff Bezos live?
rejected: user
rejected: assistant