The older soul, nose-diving into a new physical world, needs a host body. It’s something all souls are made to do; find its proper host and live there. This soul belongs to Harry James Potter so it seeks out Harry James Potter and finds him in a crib. The soul does not discriminate; the previous host was much larger, a bit older, but this host is Harry James Potter and that is all that matters.