1. A method of operating a video system to generate and store encoded video comprising a plurality of key frames and a plurality of delta frames, the method comprising: capturing video data comprising a plurality of frames of a scene; selecting a fundamental view of at least a portion of the scene contained in the plurality of frames, wherein selecting the fundamental view includes flagging portions of the scene contained in the plurality of frames that do not have a most common view; generating the plurality of key frames from a first subset of the plurality of frames and the fundamental view of at least the portion of the scene; generating the plurality of delta frames from a second subset of the plurality of frames and the plurality of key frames; and transferring the encoded video for delivery to storage.