1. A system for background image subtraction comprising: at least one processor and memory, the at least one processor programmed with one or more instructions, which when executed cause the at least one processor to: receive a video feed, the video feed comprising at least one colored image of at least one subject, and depth information; categorize pixels of the at least one colored image as foreground (FG), background (BG), or unclear (UC); re-categorize UC pixels as FG or BG using color and background history (BGH) information associated with the IX pixels and color and BGH information associated with pixels near the UC pixels; and construct a new image using the FG regions and a new background.