1. An image processing apparatus comprising: a silhouette image generator to generate a three-dimensional (3D) silhouette image of a target object using at least one of an input depth image and an input color image; a motion modeling unit to generate a skeleton model of the target object by performing motion capturing of the target object using the 3D silhouette image; and a 3D model generator to generate a 3D model of the target object by matching a template mesh model with the skeleton model of the target object using at least one processor.