it drew him away from worrying about rowan ; it drew him away from worrying about the man ; and he was just sliding back into the past , drifting by the old ivy-covered walls , and the young crepe myrtles growing thin and weedy and full of big floppy blossoms .