"He did, but never once did his earlier bouts of accidental magic bring the authorities down on him," Hermione continued. "We can only draw the conclusion that there wasn’t as much Magical ignorance in the Dursley family as the story would have us believe. I think that Harry never met his maternal grandparents because they were a witch and a wizard ... and that Dudley Dursley was prohibited from seeing them for the same reason."