1. A computer-implemented method to maintain conformity of a virtual painting onto a physical object captured and portrayed via an augmented reality device, even as the augmented reality device physically moves relative to the physical object in a physical environment over time, the computer-implemented method comprising: presenting, via a display of the augmented reality device, the physical object within a visual scene captured in the physical environment using one or more camera devices of the augmented reality device, the physical object having an area of a first color; receiving a request to at least partially fill the area using virtual paint of a second color different from the first color; responsive to the request, identifying the physical object depicted by the visual scene, based on at least one of: (i) one or more edges determined for the physical object from analyzing the visual scene; and (ii) predefined geometrical data specifying geometrical characteristics of a specified type of the physical object; determining one or more illumination characteristics of the physical environment; generating, based on an initial image of the identified physical object in the visual scene and based further on the one or more illumination characteristics of the physical environment, an initial virtual painting projected onto the area of the physical object in the initial image and as viewed from a first physical position of the augmented reality device relative to the physical object in the physical environment; and responsive to the augmented reality device being moved from the first physical position to a second physical position relative to the physical object in the physical environment, the second physical position being distinct from the first physical position, generating, based on an updated image of the identified physical object in the visual scene and based further on the one or more illumination characteristics of the physical environment, an updated virtual painting projected onto the area of the physical object in the updated image and as viewed from the second physical position of the augmented reality device, wherein the updated virtual painting is visually distinct from the initial virtual painting in terms of at least one visual aspect selected from size, shape, orientation, pattern, and color; wherein the updated virtual painting is generated in order to maintain conformity of the virtual painting onto the physical object even as the augmented reality device physically moves relative to the physical object in the physical environment over time, wherein the initial virtual painting and the updated virtual painting are output.