A salivary gland infection is typically caused by a bacterial infection. Discomfort and a foul taste in the mouth are common symptoms of a salivary gland infection. Contact your doctor immediately if you have a salivary gland infection and experience a high fever, trouble breathing or swallowing, or worsening symptoms.