How could Potter know? When Draco apparently had needed enough time and possibly adequate distance to finally void his feelings into something approaching palatable. When he could remember that he did play, and could play decently, he was in the Muggle world and it was one of the only skills that could be applied.