Sirius was damaged from Azkaban, Remus knew that, how could he not be? And sometimes he did seem to struggle a little differentiating then from now. But Harry was a child, he was James and Lily’s son.