"Severus said "we'. He's not alone, and since he didn't mention anyone by name I can guess who's there that would make me go anyways." Harry knew that his best friend Hermione would be there, and he wasn't about to leave her to deal with the Goblins.