Taking him in after finding him on their doorstep had been a decision made out of fear and hope. Fear that if they didn't the people who had left the boy would come looking for him and hope that they could save Harry from the unnaturalness that killed his parents; however the hope quickly vanished however when they realised was just as freakish as his parents.