Hermione didn't want to give the man any power over her. If he knew how uncomfortable he was making her, he would stop at nothing to increase his obnoxious actions and speech. Experience taught her that he was more malleable if she just gave him the chance to speak. She only wished that they could've had whatever discussion they apparently needed to have when she wasn't naked, wrapped in a towel.