1. A method, comprising: performing, by one or more computing devices: providing a user interface for specifying an image-based search query; receiving input via the user interface selecting an image for use as a search query; displaying one or more selectable elements on the image, wherein the selectable elements identify portions of the image that are modifiable; receiving input via the user interface making one or more modifications to the image selected for the search query, wherein the input making the one or more modifications is received on one of the selectable elements of the image to move a portion of the image identified by the selectable element to a new position within the image and thereby modify the image; performing an image similarity search using the modified image as a search query for the image similarity search; and presenting one or more other images as a result of the image similarity search, wherein the one or more images are included in the result based on similarity to the modified image.