Why should we accept "the votes of 9 people"?

One reason is that the Constitution is the supreme law of Canada, and those 9 justices interpret and apply it.

Nothing wrong with 36 residents voting on who can develop property next to them (as long as they don't do so for illegal reasons), but it's hardly the same thing.