Not selfish. In fact you don't even know his circumstances.  If the mom had a drug problem, he could have too.  He could have been more fucked up than the mom was.

He could have been living on the street.  You don't know.