I agree that pastors shouldn't get the housing allowance, but I think the way you put it is a little to charitable it two respects.
You suggest that pastors are equivalent to non-profit leaders, and they aren't.