There was no reason to bring up the awful fight they had in Hogwarts. Everyone in the room knew exactly which night he was referring to. After he stormed away from the castle shortly after learning his wife's terrible secret, he sought out his mistress the next day once he was sure his son was safe from any further harm.