1. A method, comprising: performing, by one or more computing devices: providing a user interface for specifying an image-based search query; receiving input via the user interface selecting an image for use as a search query; displaying one or more moveable selectable elements on the image, wherein each of the moveable selectable elements has a moveable position on the image, and wherein the moveable selectable elements identify portions of the image that are modifiable; receiving input via the user interface making one or more modifications to the image selected for the search query, wherein the input making the one or more modifications is a received interaction with one or more moveable selectable elements, and the received interaction is a movement of the one or more moveable selectable elements to new positions on the image; responsive to the received movement of the one or more moveable selectable elements on the image, moving a portion of the image identified by the one or more moveable selectable elements to a new position within the image and thereby modifying the image; performing an image similarity search using the modified image as a search query for the image similarity search; and presenting one or more other images as a result of the image similarity search, wherein the one or more images are included in the result based on similarity to the modified image.