Your responses to the game's questions flings the morality meter to and fro with little feedback as to why certain choices elicit moral shifts.
I can't get too worked up over this, as I think it is actually a clever representation of how seemingly benign conversations shape people's perceptions of one another.