He was growing anxious to leave the Jordan home. Not necessarily because he felt unsafe there or they weren't welcome. Like Hermione he knew that their presence there brought a target on their backs. Thanks to no one being certain who was involved in the ambush on the Junk Shop and then who came to Draco's aid at his flat because of the damned masks they wore, it was entirely possible that there were spies amongst the villagers preparing to attack again.