1. An image processing device performing processing on a captured image, the device comprising: a smoothing processing unit configured to perform a smoothing process on a pixel in a region outside a predetermined region including a set target in the captured image based on a depth corresponding to a pixel in the captured image and a set movement direction of the set target in the captured image, wherein the smoothing processing unit is implemented via at least one processor.