1 These can affect your taste because they close your taste buds.  Over-the-counter vitamins or medicines â Multivitamins with heavy metals (such as copper, zinc or chromium) or cold remedies (such as zinc lozenges) can cause a metallic taste. So can prenatal vitamins, and iron or calcium supplements. Usually the taste will go away as your body processes the vitamins or medicine.