1. A method for determining multiresolution video representations for scalable video coding, the method comprising: performing subband motion compensated temporal filtering (MCTF) on input video signals, including obtaining spatially scalable motion vectors corresponding to reduced resolutions to support combined spatial scalability and temporal scalability, wherein performing subband MCTF comprises performing spatial decomposition for each frame of the input video signals prior to performing the subband MCTF on the input video signals; and obtaining a multiresolution representation of the filtered input video signals along both spatial directions and temporal direction using a spatial-temporal scalability (ST) table with entries selectable based on spatial resolution and temporal resolution parameters for the combined spatial and temporal scalability.