Fact 1: if humans disturb animals in a location then those animals will move to a different location. 
Fact 2: The human body has evolved to eat a wide variety of animal and plant foods.
If humans disturb animals humans will have less food available to eat.