Even if you eat a healthy, balanced diet, you may find it difficult to get enough calcium if you: 1  Follow a vegan diet. 2  Have lactose intolerance and limit dairy products.  Consume large amounts of protein or sodium, which can cause your body to excrete more calcium.