Voldemort had only eight families, who supported him and he had only three, who really supported him. He hated that even Voldemort had more followers in the Wizengamot than him. Lucius had the highest number of allies and had a lot supporters from the dark, neutral and light section. The thought that even some from the light section were supporting Malfoy was making Dumbledore furious.