His carefully made plan to take over the Ministry was swept away by a single gesture made by Morgana. Making the plans to kill the Minister and having the new one firmly under his control. Allowing him to make new laws through the proxy. Eventually he would sweep in and take control himself. At that point, there wouldn’t be a fight as anyone who dared to oppose him would have been dealt with. 