When the two of them declared themselves emperors of the wizarding world, there were countless challengers. The goblins were first. With their vast wealth, they amassed mercenaries and paid for the use of powerful magic creatures. Then there was an old sect of fanatical worshippers of Voldemort who claimed the crown was his birthright and that it was their duty to take it back in his name. Finally, a sectarian branch of the old ministry who started to become uncomfortably powerful by leveraging old political connections.