Hermione was too bad at chess to know who was more likely to win at the moment, but her irritation at seeing those two play a game together simply stunned her without any magic. At least Draco had the same reaction, meaning he had gladly shut up.