Even when that path led to Harry joining Voldemort, the three were just happy that he was happy. They could see he would be much happier there than with Dumbledore. Besides, Hermione would stick by him.