Hermione could've cursed her husband for ruining the pleasant mood. Even if she knew he was right. The fact that they'd been able to remain safely in their own home was a bit of a miracle. Especially considering they were right in the middle of the village. Unless he took power immediately, they were a vulnerable target.