1. A method of encoding uncompressed video data to form compressed video data wherein the video data comprises a sequence of a plurality of image frames wherein at least some of the frames are encoded as nonkey frames that are encoded with reference to content of other, reference frames and segmentation of the reference frames, segmentation being an assignment of some or all of the pixels of the reference frame to segments based on at least one of pixel color values of the pixels and location of the pixels in the reference frame, the method comprising: encoding a first reference frame; segmenting the first reference frame into a first segmentation; matching segments of the first reference frame to pixels of the first nonkey frame; determining translations of segments from the first reference frame to the first nonkey frame using results of the step of matching; for at least one segment that is matched from first reference frame to the first nonkey frame, determining at least one other kinetic information element selected from a z-order, a deformation and a lighting change; encoding into the compressed video data a representation of the translation results from the step of determining translations; and encoding into the compressed video data a representation of the results of the step of determining at least one other kinetic information element.