He didn't speak as he dragged her away from the scene of the crime. Even though it would be dangerous to attempt, Hermione tried to reach into her pocket to remove her wand. She wasn't going to let anything happen to her without a fight. Hermione Granger was a lot of things, but a victim most definitely wasn't one of them. Before she could reach the object that could save her, the stranger thrust his hand inside her pocket to remove it first. So, clearly she wasn't dealing with a random Muggle. She wasn't sure if that realization should encourage her or not.