It could have begun at the Manor, when she was being tortured, but Draco thinks he probably would have let almost anyone escape, given the chance. No, that hadn't been specific to Hermione. He doesn't think that was really where it all began, although that was what she thought.