1 ) A method of video-to-video dynamic super-resolution for reducing memory requirements and enhancing processing speed, color and resolution for grayscale and color sequences comprising: a. using super-resolution, deblurring, and demosaicing simultaneously to incorporate color measurements encountered in video sequences; b. using a pixel-wise mean-covariance approximate of a Kalman filter for an optimal pilot fused image on a high resolution grid; c. applying advanced priors to both spatial and color-wise relationships for high quality recovery; and d. using a non-causal process mode, wherein each said pilot fused image is derived as an optimal estimate incorporating information from all frames in a sequence using smoothed said approximated pixelwise Kalman filter to obtain an efficient algorithm.