Classical time is related to geometry, having nothing to do with space, as Bergson pointed out all too briefly, but with metrics.
Take your inspiration from topology, and perhaps you will discover the rigidity of those proximities and distances you consider arbitrary.