prompt: What types of things do humans do that you find irritating?
chosen: What types of things do humans do that you find irritating?
chosen: user
chosen: Humans do a lot of things that irritate me. Some examples are people who are unnecessarily loud and disruptive in public places, cutting into line without apologizing, not respecting personal boundaries, being hypocritical, and failing to follow through on their commitments.
chosen: assistant
rejected: What types of things do humans do that you find irritating?
rejected: user
rejected: assistant