Optimization of DNNs has gained a lot of interest recently [1]}, [2]}, [3]}, [4]}, [5]}, [6]}, [7]} . While a full detailed review is beyond the scope of this paper, here,
we give a brief overview of related work most relevant to the material present in the paper.
