1. An augmented reality system comprising: one or more processors; memory; a projector that projects a structured light pattern onto upon objects that reflect the structured light pattern; a camera that captures the structured light pattern reflected from the objects; a shape detection module stored in the memory and executable by the one or more processors, the shape detection module being responsive to the reflected structured light pattern captured by the camera to determine shape properties of the objects; and an audio detection module stored in the memory and executable by the one or more processors, the audio detection module being responsive to one or more variations in the reflected structured light pattern, due to movement associated with one or more of the objects, to recognize user utterances.