1. A method performed by a computing system for augmenting reality, comprising: receiving a captured image; determining location information relating to the received captured image; transmitting the determined location information to a server computing device; receiving one or more tags from the server computing device, each tag including one or more patches and supplementary information corresponding to at least one of the patches, each patch including a patch image and location information that specifies a location that is near a location specified by the determined location information; determining, using a template matching process, whether at least one of the received one or more patch images appears in the received captured image; and in response to a determination that a first patch image appears in the received image, rendering the supplementary information corresponding to the patch associated with the first patch image.