1. An image processing apparatus comprising: an encoding mode setter configured to determine, in a coding unit which is formed by recursively splitting a largest coding unit into smaller coding units as block partitioning, whether a non-compression mode is to be selected as an encoding mode for encoding image data, the non-compression mode being the encoding mode in which the image data is output as encoded data; a filter processing controller configured to perform control, on the coding unit for which the non-compression mode has been determined by the encoding mode setter, to skip filter processing in which filtering is performed on a locally decoded image after a deblocking filter; and an encoder configured to encode the image data using the locally decoded image in accordance with the encoding mode determined by the encoding mode setter, wherein the encoding mode setter, the filter processing controller, and the encoder are each implemented via at least one processor.