1. A method, comprising: receiving at least one video frame of an environment; generating a surface reconstruction of the environment; projecting a plurality of rays within the surface reconstruction of the environment; generating illumination data of the environment from the at least one video frame; determining a subset of rays from the plurality of rays in the environment based on areas within the environment needing refinement; and rendering a virtual object over the at least one video frame based on the plurality of rays excluding the subset of rays.