It was harder when he was younger. Last few years in Hogwarts he had to follow Harry around. He had to desperately look for his attention and fail over and over again. He became wiser with time. He learned to manage.