1. A method for processing images, the method comprising: using one or more processors to perform steps comprising: analyzing an image provided at a third-party website in connection with displaying concurrently one or more other images at the third-party website that satisfy a search criterion generated from analyzing the image, wherein analyzing the image includes: programmatically analyzing the image to determine one or more visual characteristics of at least one object in the image; generate a search criterion based at least in part on the one or more visual characteristics of the at least one object; performing a search of a data store using the search criterion in order to obtain a search result that includes one or more images of merchandise objects that satisfy the search criterion; and presenting the one or more images of merchandise objects with the analyzed image at the third-party website; wherein programmatically analyzing the image further comprises determining one or more categories of the at least one object of the analyzed image based at least in part on (i) text and/or metadata associated with the image; and (ii) a reference record assigned to each of the one or more categories that identifies words or phrases and their respective weights for use in determining that the one or more categories are relevant to the analyzed image; wherein performing the search further comprises identifying at least one image of a merchandise object that (i) is deemed similar to the at least one object of the analyzed image, but (ii) is in a different category than the at least one object of the analyzed image.