That shuts down conversation, the Grangers clearly deeply uncomfortable, and nothing that Harry does draws things back out. He gives a stilted tour of the family wing, explaining they haven’t really gone exploring elsewhere yet, and waits for them to decide it’s time to take Hermione home.