Durmstrang, being far smaller than Hogwarts, was much more intimate. If one person knew something, everyone did. So the boys mouthed off about what they would do to teach Hermione a lesson, and even the older children watched the situation with some amount of interest.