Quick Answer. Feta cheese and goat cheese are both made from the milk of goats. The difference is that feta is also made using sheep's milk. In fact the majority, or 70 percent, of the milk used in feta is sheep's milk. Some feta is made entirely with sheep's milk.