Madam Rosmerta must’ve told the other visitors that the High Reeve was here with Hermione Granger because all of them started throwing not-so-hidden glances their way. Madam Rosmerta probably thought what Malfoy wanted them all to think – that Hermione was his to control, that she was his to own, even though he called her his wife. They must know that title can mean no good.