Every single time someone else has decided things for Harry, it has gone horribly. This world he had discovered had allowed Harry to feel free of their control, his anger at the fact they had been hiding this from him was still something he hadn't really dealt with, there fear at magic, there fear about something they couldn't understand had resulted in Harry suffering, he had suffered because of their ignorance and fear.