1. A method for temporally filtering a video sequence, the method comprising: using object motion estimation for arbitrarily shaped segments to align corresponding pixels between at least two frames by a temporal filtering apparatus; determining segments that are no longer adjacent to a segment boundary based on said object motion estimation by the temporal filtering apparatus; reducing impact of color blur from said segments that are no longer adjacent by adjusting weights assigned to one or more frames for pixels that lie within a blur region near said segment boundary by the temporal filtering apparatus; setting the weight for one or more past frames to zero for pixels that lie within a newly exposed area; and computing a weighted average of color values of said corresponding pixels by the temporal filtering apparatus.