Not only the fact that Zabini had insinuated that Hermione would be waiting for Draco - which she incidentally was just then - but it was more the fact that Draco was prepared to protect her from being exposed as his because they both knew what that would cause.