They couldn’t ignore the wizardry world forever.  They needed Diagon Alley.  Hadrian had slipped away from his Dumbledore-assigned minder before buying a wand.  They could only go so far in schooling without.  Reggie didn’t want any of the wands in Grimmauld Place to infect his son with the Black Madness, so Ollivander was required.