At least Glass users telegraph their intentions--they're totally conspicuous, and can't hide behind a veil of anonymity.
An overly attentive Glass wearer may be the least of your worries when it comes to someone recording your every move on camera.