What’s happening instead was these girls were helping him survive to grow and dare I say stronger and that is not what the greater good requires, he has to be weak, why else would I send him to the Dursley's.