1. A method, comprising: obtaining a current frame and a next frame of a video frame sequence comprising a plurality of frames, and obtaining a segmentation for the current frame, the segmentation indicating a region of interest in the current frame and the region of interest including a plurality of pixels in the current frame; computing optical flow for the current frame relative to the next frame; and generating a dynamic color flow model for a region of interest in the next frame comprising: for each pixel in the region of interest in the current frame: determining a motion vector for the pixel relative to the next frame by computing the motion vector as a locally averaged optical flow for the pixel, the motion vector indicating a predicted location for the pixel in the next frame; generating a local probability map for the pixel in the next frame centered at the predicted location and in which variance of the local probability map is determined according to magnitude of the respective motion vector; determining variance of the local probability map according to magnitude of the respective motion vector in which a higher magnitude of the motion vector results in a larger window for the respective local probability map, and a smaller magnitude of the motion vector results in a smaller window for the respective local probability map; and propagating colors from the pixels in the region of interest in the current frame to pixels in the next frame according to the generated local probability maps.