1. A method for retrieving images from an image database with a pre-computed index keyed according to color surface labels comprising the steps: receiving a semantic query representing at least one color surface label; finding an index entry within said index matching said semantic query; identifying, from said index entry, at least one image containing regions corresponding to said at least one color surface label, and retrieving each of said at least one identified images.