1. A method of augmenting an appearance of a first object, comprising: capturing a visual scene for display, wherein the visual scene includes a physical object and wherein the visual scene is captured using one or more camera devices; identifying the physical object as a first predetermined object type, based on one or more object identifiers associated with the physical object; retrieving visual characteristics information corresponding to the first predetermined object type; and rendering, by operation of one or more computer processors, a sequence of frames for display that includes the first object, wherein the appearance the first object in the rendered sequence of frames is augmented based on the retrieved visual characteristics information and an appearance of the physical object in the captured visual scene.