Your solutions have problems.

1)  There is no loophole.  Under the 1985 Singh case from the SCOC any person who makes it inside our borders is covered by the Charter - there is a reason the Charter refers to "everyone" in section 7.  In fact the Safe Third Country Agreement exploited a loophole... since technically a person at a port of entry is not within Canada, the Charter does not apply.

2)Military??? Seriously?  This is a law enforcement matter and even if a public safety emergency was to be declared, the Emergencies Act is subject to the Charter.

3) Many refugee claimants are already detained on grounds set out in the IRPA but the Charter would prevent automatic detention.  BTW detention is incredibly expensive.

4)  Appeals and removals have already been streamlined.