"Maybe you do, but he might have thought it, too," Hermione pointed out. "And it would be a reasonable assumption. He couldn’t touch you at Privet Drive until you Came of Age ... it’s not too much of a stretch for him to think that the Dursleys were active and complicit in protecting you."