So your relationship with your ISP is contractual more than anything else.
The idea that all bits are equal is not even desirable to most people: You may not want to have you VOIP prioritized over span, but most people do.