"subject to being limited in a reasonable way"
The biggest single problem with our charter. "well you have rights but we can take them away.." is not in any way a right, they have given us all privileges and hidden the nature of that by calling them rights. Some guarantee.
Who gets to decide what is reasonable? Why politicians of course, and the judges they appoint. What could go wrong.
And libel laws have little to do with the charter imposing limits - the US has almost limitless free speech but they still have libel, laws.