I've noticed that as well. What others see in my silence depends on the individual. Some think that I'm simply being snobby or stand-offish, some think that I'm just rude (maybe it's my resting face...