Raising a goat for its cashmere isnât much different than other goats â except for its diet. You donât want to feed a lot of protein because when you do it coarsens their cashmere, says Bohnert. So, the goatsâ diet in their natural setting is primarily browse, which is weeds and leaves, theyâll eat berries.