1. A computer-implemented method comprising: creating a geometric proxy for a particular participant in an online meeting using color and depth information from an image of the particular participant; generating scene geometry based on a number of participants in the online meeting including the particular participant and one or more other participants; rendering the geometric proxy for the particular participant and one or more geometric proxies for the one or more other participants in the online meeting within the scene geometry to cause the scene geometry to visually simulate an in-person conversation; and causing a virtual viewpoint to be displayed for the particular participant that includes one or more rendered geometric proxies for the one or more other participants along with a background that is part of the scene geometry, the virtual viewpoint being displayed based on a position of the particular participant's face.