1. An apparatus for analysis and recovery of structure in an image inpainting process after object removal, comprising: (a) a computer processor; and (b) programming executable on the computer processor for analyzing structures about a missing object area within a received image toward recovering structures inside the missing object area and performing inpainting of the missing object area according to the recovered structure by performing steps comprising: (i) detecting structure edges, extensions and intersections for a missing object area being inpainted within an image; (ii) deciding which structure edges to extend; (iii) extending structure edges into the missing object area in response to color and depth information; (iv) synthesizing structure regions into the missing object area; and (v) synthesizing remaining missing object area outside of structure regions to complete inpainting of the removed object area.