Even if Hermione had the intention to go to visit Madam Pomfrey in the infirmary, she wouldn’t have been able to find the damn place without asking for directions. She would likely receive quite a few curious stares if she went about  asking for help  in a school she— the Hermione Granger— supposedly attended for the last few years. 