1. An apparatus, comprising: an image signal processor that comprises a temporal filter module, wherein the image signal processor is configured to: determine a filter weight for blending a given pixel of a plurality of pixels that comprise a current image frame received at a temporal filter module for filtering with a corresponding pixel of a plurality of pixels that are maintained as part of a previously filtered reference image frame, wherein the determination is based, at least in part, on a difference between one or more neighboring pixels of the given pixel in the current image frame and one or more pixels of the plurality of pixels of the reference image frame that are neighboring pixels of the corresponding pixel; modify the filter weight according to a quality score for the corresponding pixel of the reference image frame, wherein the quality score indicates a noise history for the corresponding pixel with respect to noise of the given pixel; and generate a filtered version of the given pixel as part of a filtered version of the current image frame, wherein the generation blends the given pixel of the current image frame with the corresponding pixel of the reference image frame according to the modified filter weight.