1. A computer-implementable method for dynamically controlling a multi-modal camera system, comprising: receiving a plurality of image streams from the multi-modal camera system; performing an image analysis on the plurality of image streams provided by the multi-modal camera; and, balancing resource utilization and gesture detection accuracy based upon the image analysis, the balancing resource utilization and gesture detection accuracy dynamically changing camera modes of the multi-modal camera and configuring the plurality of image streams to provide a gesture recognizer with data to accurately detect gestures while minimizing resource utilization of an information handling system, the information handling system comprising power resources and the minimizing resource utilization comprising minimizing power consumption; and, detecting conditions of the image streams and configuring modes of operation of the multi-modal camera based upon the conditions; and wherein the conditions comprise a complex background condition, a low light condition, an out-of-range condition, a power condition, a low contrast condition and a hand tracking condition.