Funny, I recall Brian touting the GST as more or less revenue neutral, since he was supposed to greatly reduce excise taxes and have business pass the savings on to us.   Didn't turn out that way as far as I could see -- everything just got more expensive -- but he was hardly acting as a deficit buster.

Most of Martin's savings came from the provinces.  He reduced transfer payments for things that were clearly provincial responsibilities.  This had a much greater effect than GST revenue.  Didn't help the average taxpayer much, though, since those costs still had to be paid by either provincial deficits or provincial tax increases.

Check this pdf for an interesting history of deficits.  Clark started, Trudeau accelerated, Mulroney took it off the map.  Chretien and Martin began to get things under control, then Harper pumped it up yet again.

https://www.taxpayer.com/media/CoverStory24-27WEB.pdf