In all honesty, he was more worried about Draco’s return to Hogwarts than his own. Harry swore he would never let Draco out of his sight. He knew firsthand how cruel people could be, and how quickly they could turn against you. Draco may have done some bad things in his past, but once you get past that harsh exterior, he was so kind and loving.