1. A method of operation of a display system comprising: receiving an input image having input pixels; assigning a pixel information for the input pixels corresponding to a semantic category; detecting input background pixels from the input pixels with the pixel information; identifying input foreground pixels from the input pixels with the input background pixels; assigning a pixel depth to the input background pixels and input foreground pixels; generating a depth map with the input background pixels and the input foreground pixels; and generating a processed image from the input image with the depth map for displaying on a device.