I agree - our population would be declining. 

The concern is that there are immigrants who come here with their millions already in the bank.  Untouchable by the CRA.  And don't forget that property taxes in Vancouver (I'm not sure of Toronto's) are some of the lowest in the country (Averages about $7k on a $1.5M home - note that in Toronto the same home would have yearly taxes of $10k and New York  about $37k).  Thus the taxes paid are probably less than the gov't benefits (e.g. health care) these families are getting.

It is our middle class that is being squeezed by higher home costs as well as a greater tax burden (I'm considering that the income tax deduction is far offset by a CPP expansion).

So, your argument doesn't hold as much water as you would like.